Sep 25 15:58:14 devstack cinder-volume[76212]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 15:58:14 devstack cinder-volume[76212]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 15:58:14 devstack cinder-volume[76212]: we strongly recommend against using it for new projects. Sep 25 15:58:14 devstack cinder-volume[76212]: If you are already using Eventlet, we recommend migrating to a different Sep 25 15:58:14 devstack cinder-volume[76212]: framework. For more detail see Sep 25 15:58:14 devstack cinder-volume[76212]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 15:58:14 devstack cinder-volume[76212]: import eventlet # noqa Sep 25 15:58:17 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 15:58:17 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 15:58:17 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 15:58:18 devstack cinder-volume[76212]: INFO dbcounter [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Registered counter for database cinder Sep 25 15:58:18 devstack cinder-volume[76212]: DEBUG oslo_db.sqlalchemy.engines [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:18 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writer thread running {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 15:58:18 devstack cinder-volume[76212]: INFO cinder.rpc [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 15:58:18 devstack cinder-volume[76212]: INFO cinder.rpc [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 15:58:18 devstack cinder-volume[76212]: DEBUG oslo_db.sqlalchemy.engines [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:18 devstack cinder-volume[76212]: INFO cinder.volume.manager [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Determined volume DB was empty at startup. Sep 25 15:58:18 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76212) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 15:58:18 devstack cinder-volume[76212]: INFO cinder.volume.manager [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 15:58:18 devstack cinder-volume[76212]: WARNING stevedore.named [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 15:58:18 devstack cinder-volume[76212]: WARNING castellan.key_manager [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:58:18 devstack cinder-volume[76212]: WARNING cinder.keymgr.conf_key_mgr [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:58:18 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76212) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 15:58:18 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] CMD "cinder-rtstool verify" returned: 0 in 0.530s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_db.sqlalchemy.engines [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:19 devstack cinder-volume[76212]: INFO cinder.rpc [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 15:58:19 devstack cinder-volume[76212]: INFO cinder.rpc [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 15:58:19 devstack cinder-volume[76212]: WARNING stevedore.named [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 15:58:19 devstack cinder-volume[76212]: WARNING castellan.key_manager [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 15:58:19 devstack cinder-volume[76212]: INFO cinder.volume.manager [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_db.sqlalchemy.engines [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:19 devstack cinder-volume[76212]: INFO oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Starting 1 workers Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Started child 76373 {{(pid=76212) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Full set of CONF: {{(pid=76212) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] ******************************************************************************** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Configuration options gathered from: {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] ================================================================================ {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] allow_availability_zone_fallback = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] allow_compression_on_image_upload = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] allowed_direct_url_schemes = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] api_rate_limit = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] auth_strategy = keystone {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] az_cache_duration = 3600 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_availability_zone = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_host = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_stats_polling_interval = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backup_api_class = cinder.backup.api.API {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76373]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backup_name_template = backup-%s {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backup_use_same_host = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backup_use_temp_snapshot = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] chap_password = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] chap_username = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_internal_tenant_project_id = 29ebe002263f45fab76bca45e9a46117 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_internal_tenant_user_id = 03f01e47b85b4ccb88f06b35b55f0abd {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cloned_volume_same_az = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cluster = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] compression_format = gzip {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] compute_api_class = cinder.compute.nova.API {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] config_dir = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] config_source = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] control_exchange = openstack {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] debug = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] default_availability_zone = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] default_group_type = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] default_volume_type = lvmdriver-1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] disk_geometry = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] driver_client_cert = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] driver_client_cert_key = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] driver_data_namespace = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] driver_ssl_cert_path = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] driver_ssl_cert_verify = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] driver_use_ssl = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] enable_force_upload = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] enable_new_services = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] enable_unsupported_driver = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] enforce_multipath_for_image_xfer = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] filter_function = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_api_insecure = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_api_ssl_compression = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_ca_certificates_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_catalog_info = image:glance:publicURL {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_num_retries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance_request_timeout = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] goodness_function = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] graceful_shutdown_timeout = 5 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] group_api_class = cinder.group.api.API {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] host = devstack {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_compress_on_upload = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_conversion_address_space_limit = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_conversion_cpu_limit = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_conversion_disable = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_introspection_address_space_limit = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_introspection_cpu_limit = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_upload_use_cinder_backend = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_upload_use_internal_tenant = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_volume_cache_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_volume_cache_max_count = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] image_volume_cache_max_size_gb = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] init_host_max_objects_retrieval = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] instance_format = [instance: %(uuid)s] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] iscsi_target_flags = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] iscsi_write_cache = on {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] iser_helper = tgtadm {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] iser_ip_address = 192.168.122.196 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] iser_port = 3260 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_color = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_config_append = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_dir = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_options = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_rotate_interval = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_rotate_interval_type = days {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] log_rotation_type = none {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] max_age = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76373]: INFO cinder.volume.manager [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] max_logfile_count = 30 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] max_logfile_size_mb = 200 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] max_over_subscription_ratio = 20.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] message_reap_interval = 86400 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] message_ttl = 2592000 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] migration_create_volume_timeout_secs = 300 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] monkey_patch = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] monkey_patch_modules = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] my_ip = 192.168.122.196 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] no_snapshot_gb_quota = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] num_iser_scan_tries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] num_shell_tries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] num_volume_device_scan_tries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] nvmeof_conn_info_version = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] nvmet_ns_id = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] nvmet_port_id = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] osapi_max_limit = 1000 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] osapi_volume_ext_list = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] osapi_volume_listen_port = 8776 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] osapi_volume_use_ssl = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] osapi_volume_workers = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] per_volume_size_limit = -1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] periodic_fuzzy_delay = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] periodic_interval = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] public_endpoint = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] publish_errors = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] quota_backup_gigabytes = 1000 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] quota_backups = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] quota_gigabytes = 1000 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] quota_groups = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] quota_snapshots = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] quota_volumes = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] rate_limit_burst = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] rate_limit_except_level = CRITICAL {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] rate_limit_interval = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] reinit_driver_count = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] replication_device = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] report_discard_supported = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] report_interval = 120 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] reservation_clean_interval = 86400 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] reservation_expire = 86400 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] reserved_image_namespaces = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] reserved_percentage = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] rpc_response_timeout = 120 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] run_external_periodic_tasks = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] scst_target_driver = iscsi {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] scst_target_iqn_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_down_time = 720 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] shell_completion = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] snapshot_name_template = snapshot-%s {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] snapshot_same_host = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] split_loggers = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] state_path = /opt/stack/data/cinder {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] storage_availability_zone = nova {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] storage_protocol = iSCSI {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] syslog_log_facility = LOG_USER {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] target_helper = lioadm {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] target_ip_address = 192.168.122.196 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] target_port = 3260 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] target_protocol = iscsi {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] target_secondary_ip_addresses = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] trace_flags = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] transport_url = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] until_refresh = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] use_chap_auth = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] use_default_quota_class = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] use_journal = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] use_json = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] use_multipath_for_image_xfer = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] use_stderr = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] use_syslog = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] verify_glance_signatures = enabled {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_api_class = cinder.volume.api.API {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_backend_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_clear = zero {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_clear_ionice = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_clear_size = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_copy_bps_limit = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_dd_blocksize = 1M {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_name_template = volume-%s {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_service_inithost_offload = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volume_usage_audit_period = month {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] zoning_mode = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_concurrency.disable_process_locking = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.auth_section = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.auth_type = password {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.auth_version = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.cache = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.include_service_catalog = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.insecure = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.interface = public {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_password = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcache_username = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.region_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.service_type = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.backend = dogpile.cache.null {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.backend_argument = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.backend_expiration_time = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.config_prefix = cache.oslo {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.debug_cache_backend = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.enable_retry_client = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.enable_socket_keepalive = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.expiration_time = 600 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.hashclient_retry_attempts = 2 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.memcache_dead_retry = 300 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.memcache_pool_maxsize = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.memcache_sasl_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.password = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.proxies = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.redis_db = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.redis_server = localhost:6379 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.retry_attempts = 2 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.retry_delay = 0.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.socket_keepalive_count = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.socket_keepalive_idle = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.socket_keepalive_interval = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.socket_timeout = 1.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.tls_allowed_ciphers = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.tls_cafile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.tls_certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.tls_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.tls_keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cache.username = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] coordination.backend_url = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.asyncio_connection = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.asyncio_slave_connection = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.backend = sqlalchemy {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.connection = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.connection_debug = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.connection_parameters = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.connection_recycle_time = 3600 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.connection_trace = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.db_inc_retry_interval = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.db_max_retries = 20 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.db_max_retry_interval = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.db_retry_interval = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.max_overflow = 50 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.max_pool_size = 5 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.max_retries = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.mysql_wsrep_sync_wait = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.pool_timeout = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.retry_interval = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.slave_connection = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.sqlite_synchronous = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.synchronous_reader = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] database.use_db_reconnect = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack sudo[76377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_tracing.insecure = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack sudo[76377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.connection_string = messaging:// {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.es_doc_type = notification {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.es_scroll_size = 10000 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.es_scroll_time = 2m {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.filter_error_trace = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.hmac_keys = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.sentinel_service_name = mymaster {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.socket_timeout = 0.1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.trace_requests = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler.trace_sqlalchemy = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler_jaeger.process_tags = {} {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler_jaeger.service_name_prefix = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] profiler_otlp.service_name_prefix = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.enforce_new_defaults = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.policy_default_rule = default {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.policy_file = policy.yaml {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] privsep_osbrick.group = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] privsep_osbrick.helper_command = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] privsep_osbrick.user = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_sys_admin.group = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_sys_admin.helper_command = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] cinder_sys_admin.user = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.auth_section = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.auth_type = password {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.cafile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.collect_timing = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.insecure = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.send_service_user_token = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.split_loggers = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.timeout = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.tls_ciphers = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] service_user.tls_min_version = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.auth_section = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.auth_type = password {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.collect_timing = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.insecure = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.region_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.split_loggers = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.timeout = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.tls_ciphers = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] glance.tls_min_version = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.backend_availability_zone = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.chap_password = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.chap_username = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.disk_geometry = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.driver_client_cert = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.driver_client_cert_key = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.driver_data_namespace = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.driver_use_ssl = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.extra_capabilities = {} {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.filter_function = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.goodness_function = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.iscsi_target_flags = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.iscsi_write_cache = on {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.iser_helper = tgtadm {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.iser_port = 3260 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.lvm_share_target = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.lvm_type = auto {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.num_shell_tries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.replication_device = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.report_discard_supported = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.reserved_percentage = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.target_helper = tgtadm {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.target_port = 3260 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.target_protocol = iscsi {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.trace_flags = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.unique_fqdn_network = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.use_chap_auth = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_backend_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_clear = zero {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_clear_ionice = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_clear_size = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_reports.file_event_handler = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_reports.log_dir = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.backend_host = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.chap_password = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.chap_username = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.disk_geometry = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.driver_client_cert = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.extra_capabilities = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.filter_function = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.goodness_function = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.iser_helper = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.iser_ip_address = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.iser_port = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.lvm_share_target = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.lvm_type = auto {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.num_shell_tries = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.replication_device = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.report_discard_supported = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.reserved_percentage = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.scst_target_driver = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.storage_protocol = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.target_helper = lioadm {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.target_ip_address = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.target_port = 3260 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.trace_flags = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.use_chap_auth = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_clear = zero {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_clear_size = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] lvmdriver-1.volumes_dir = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.ssl = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_notifications.driver = [] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_notifications.retry = -1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] key_manager.fixed_key = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.barbican_api_version = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.barbican_endpoint = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.barbican_endpoint_type = public {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.barbican_region_name = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.cafile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.collect_timing = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.insecure = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.number_of_retries = 60 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.retry_delay = 1 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.send_service_user_token = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.split_loggers = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.timeout = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.tls_ciphers = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.tls_min_version = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.verify_ssl = True {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican.verify_ssl_path = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.auth_section = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.auth_type = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.cafile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.certfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.collect_timing = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.insecure = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.keyfile = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.split_loggers = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.timeout = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.tls_ciphers = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] barbican_service_user.tls_min_version = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.approle_role_id = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.approle_secret_id = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.auth_method = approle {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.auth_path = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.kv_mountpoint = secret {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.kv_path = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.kv_version = 2 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.namespace = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.root_token_id = **** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.ssl_ca_crt_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.timeout = 60.0 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.token_file = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.token_role = None {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.use_ssl = False {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 15:58:19 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] ******************************************************************************** {{(pid=76212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 15:58:19 devstack sudo[76377]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:19 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:20 devstack sudo[76532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:20 devstack sudo[76532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:20 devstack sudo[76532]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.246s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 15:58:20 devstack cinder-volume[76373]: INFO cinder.brick.local_dev.lvm [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:20 devstack sudo[76633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:20 devstack sudo[76633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:20 devstack sudo[76633]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG cinder.brick.local_dev.lvm [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76373) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 15:58:20 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:20 devstack sudo[76737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:20 devstack sudo[76737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:21 devstack sudo[76737]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.545s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:21 devstack sudo[76978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:21 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:21 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:21 devstack sudo[76982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 15:58:21 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:21 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.336s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:21 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:21 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:21 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:22 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:22 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:22 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:22 devstack sudo[77068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:22 devstack sudo[77068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:22 devstack sudo[77068]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:22 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.395s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:22 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:22 devstack sudo[77191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:22 devstack sudo[77191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:22 devstack sudo[77191]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:22 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:22 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:22 devstack sudo[77196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:22 devstack sudo[77196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:23 devstack sudo[77196]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.318s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:23 devstack sudo[77200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:23 devstack sudo[77200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:23 devstack sudo[77200]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:23 devstack cinder-volume[76373]: INFO cinder.volume.drivers.lvm [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:23 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:23 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:23 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG cinder.volume.drivers.lvm [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Updating volume stats {{(pid=76373) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:58:23 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:23 devstack sudo[77214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:23 devstack sudo[77214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:24 devstack sudo[77214]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:24 devstack sudo[77217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:24 devstack sudo[77217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:24 devstack sudo[77217]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:24 devstack sudo[77220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:24 devstack sudo[77220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:24 devstack sudo[77220]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:24 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:24 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:24 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:24 devstack cinder-volume[76373]: INFO cinder.volume.driver [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 15:58:24 devstack cinder-volume[76373]: DEBUG cinder.volume.driver [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76373) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG oslo_db.sqlalchemy.engines [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76373) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG dbcounter [-] [76373] Writer thread running {{(pid=76373) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG cinder.db.api [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Building query based on filter {{(pid=76373) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG cinder.image.image_utils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76373) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1322}} Sep 25 15:58:25 devstack cinder-volume[76373]: INFO cinder.keymgr.migration [None req-660bf41e-d2b3-40e8-ac28-996c957caa9a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG cinder.volume.drivers.lvm [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Updating volume stats {{(pid=76373) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:25 devstack sudo[77229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:25 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:25 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:25 devstack sudo[77232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:25 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:25 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:25 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:25 devstack sudo[77235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:25 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:26 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:26 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:26 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:26 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG cinder.manager [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Notifying Schedulers of capabilities ... {{(pid=76373) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 15:58:26 devstack cinder-volume[76373]: INFO cinder.volume.manager [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Driver initialization completed successfully. Sep 25 15:58:26 devstack cinder-volume[76373]: INFO cinder.manager [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Initiating service 2 cleanup Sep 25 15:58:26 devstack cinder-volume[76373]: INFO cinder.manager [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Service 2 cleanup completed. Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG cinder.service [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Creating RPC server for service cinder-volume {{(pid=76373) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG cinder.service [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76373) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 15:58:26 devstack cinder-volume[76373]: INFO cinder.volume.manager [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG cinder.volume.drivers.lvm [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Updating volume stats {{(pid=76373) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:26 devstack sudo[77243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 15:58:26 devstack sudo[77243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:26 devstack sudo[77243]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:26 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:26 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:26 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:27 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:27 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:27 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:27 devstack sudo[77252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 15:58:27 devstack sudo[77252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:27 devstack sudo[77252]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:27 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:27 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 15:58:27 devstack sudo[77255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 15:58:27 devstack sudo[77255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 15:58:27 devstack sudo[77255]: pam_unix(sudo:session): session closed for user root Sep 25 15:58:27 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 15:58:27 devstack cinder-volume[76373]: INFO cinder.volume.manager [None req-b922ce79-fd63-4d0e-9150-733f58985ea0 None None] Driver post RPC initialization completed successfully. Sep 25 15:58:29 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:58:37 devstack cinder-volume[76373]: DEBUG dbcounter [-] [76373] Writing DB stats cinder:SELECT=3 {{(pid=76373) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:58:37 devstack cinder-volume[76373]: DEBUG dbcounter [-] [76373] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76373) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 15:59:04 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager._thread_info {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 15:59:04 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread count: 6 {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 15:59:04 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread info: [<_MainThread(MainThread, started 126918470557824)>, , , , , ] {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:00:04 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:00:04 devstack cinder-volume[76373]: DEBUG cinder.volume.drivers.lvm [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Updating volume stats {{(pid=76373) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:00:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:04 devstack sudo[82428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:00:04 devstack sudo[82428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:04 devstack sudo[82428]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:04 devstack sudo[82433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:00:04 devstack sudo[82433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:05 devstack sudo[82433]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:05 devstack sudo[82437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:00:05 devstack sudo[82437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:05 devstack sudo[82437]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:00:05 devstack sudo[82440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:00:05 devstack sudo[82440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:00:05 devstack sudo[82440]: pam_unix(sudo:session): session closed for user root Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG cinder.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Notifying Schedulers of capabilities ... {{(pid=76373) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager._thread_info {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread count: 6 {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:00:05 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread info: [<_MainThread(MainThread, started 126918470557824)>, , , , , ] {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:00:37 devstack cinder-volume[76373]: DEBUG dbcounter [-] [76373] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76373) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:01:04 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:01:04 devstack cinder-volume[76373]: DEBUG cinder.volume.drivers.lvm [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Updating volume stats {{(pid=76373) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:01:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:04 devstack sudo[83721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:01:04 devstack sudo[83721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:04 devstack sudo[83721]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:04 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:01:04 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:05 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:05 devstack sudo[83766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:01:05 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:05 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:01:05 devstack sudo[83797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:01:05 devstack sudo[83797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:01:05 devstack sudo[83797]: pam_unix(sudo:session): session closed for user root Sep 25 16:01:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:01:05 devstack cinder-volume[76373]: DEBUG cinder.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Notifying Schedulers of capabilities ... {{(pid=76373) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:02:04 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:02:04 devstack cinder-volume[76373]: DEBUG cinder.volume.drivers.lvm [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Updating volume stats {{(pid=76373) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:02:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:04 devstack sudo[85259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:02:04 devstack sudo[85259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:04 devstack sudo[85259]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:04 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:02:04 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:05 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:05 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:02:05 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:05 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:02:05 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:02:05 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:02:05 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG cinder.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Notifying Schedulers of capabilities ... {{(pid=76373) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager._thread_info {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread count: 6 {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:02:05 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread info: [<_MainThread(MainThread, started 126918470557824)>, , , , , ] {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:02:37 devstack cinder-volume[76373]: DEBUG dbcounter [-] [76373] Writing DB stats cinder:SELECT=1 {{(pid=76373) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:02:37 devstack cinder-volume[76373]: DEBUG dbcounter [-] [76373] Writing DB stats cinder:UPDATE=1 {{(pid=76373) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:03 devstack cinder-volume[76212]: INFO oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Caught SIGTERM, stopping children Sep 25 16:03:03 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Acquiring lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:03 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Acquired lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:03 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Releasing lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:03 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Stop services. {{(pid=76212) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 16:03:03 devstack cinder-volume[76212]: DEBUG oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Killing children. {{(pid=76212) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 16:03:03 devstack cinder-volume[76212]: INFO oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Waiting on 1 children to exit Sep 25 16:03:04 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:03:04 devstack cinder-volume[76373]: DEBUG cinder.volume.drivers.lvm [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Updating volume stats {{(pid=76373) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:03:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:04 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:03:04 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:04 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:04 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:04 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:03:04 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:05 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:05 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:03:05 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:05 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:05 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:03:05 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:05 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG oslo_concurrency.processutils [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76373) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG cinder.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Notifying Schedulers of capabilities ... {{(pid=76373) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG oslo_service.periodic_task [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] Running periodic task VolumeManager._thread_info {{(pid=76373) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread count: 6 {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:03:05 devstack cinder-volume[76373]: DEBUG cinder.volume.manager [None req-d8e2e5ac-171c-430e-b719-08f1e9256621 None None] thread info: [<_MainThread(MainThread, started 126918470557824)>, , , , , ] {{(pid=76373) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:03:06 devstack cinder-volume[76373]: DEBUG oslo_concurrency.lockutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Acquiring lock "singleton_lock" {{(pid=76373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:06 devstack cinder-volume[76373]: DEBUG oslo_concurrency.lockutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Acquired lock "singleton_lock" {{(pid=76373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:06 devstack cinder-volume[76373]: DEBUG oslo_concurrency.lockutils [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Releasing lock "singleton_lock" {{(pid=76373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:06 devstack cinder-volume[76373]: WARNING amqp [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:03:06 devstack cinder-volume[76373]: WARNING amqp [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:03:06 devstack cinder-volume[76212]: INFO oslo_service.backend._eventlet.service [None req-1388c4a9-5dec-4094-a0e8-d28fc7eb2f94 None None] Child 76373 exited with status 0 Sep 25 16:03:06 devstack cinder-volume[86461]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:03:06 devstack cinder-volume[86461]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:03:06 devstack cinder-volume[86461]: we strongly recommend against using it for new projects. Sep 25 16:03:06 devstack cinder-volume[86461]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:03:06 devstack cinder-volume[86461]: framework. For more detail see Sep 25 16:03:06 devstack cinder-volume[86461]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:03:06 devstack cinder-volume[86461]: import eventlet # noqa Sep 25 16:03:09 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:09 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:09 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:10 devstack cinder-volume[86461]: INFO dbcounter [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Registered counter for database cinder Sep 25 16:03:10 devstack cinder-volume[86461]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:10 devstack cinder-volume[86461]: DEBUG dbcounter [-] [86461] Writer thread running {{(pid=86461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:10 devstack cinder-volume[86461]: INFO cinder.rpc [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:03:10 devstack cinder-volume[86461]: INFO cinder.rpc [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:03:10 devstack cinder-volume[86461]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:10 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Determined volume DB was empty at startup. Sep 25 16:03:10 devstack cinder-volume[86461]: DEBUG cinder.volume.manager [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86461) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:03:10 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 16:03:10 devstack cinder-volume[86461]: WARNING stevedore.named [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:03:10 devstack cinder-volume[86461]: WARNING castellan.key_manager [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:10 devstack cinder-volume[86461]: WARNING cinder.keymgr.conf_key_mgr [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:10 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 16:03:10 devstack cinder-volume[86461]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:11 devstack cinder-volume[86461]: INFO oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Starting 1 workers Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Started child 86744 {{(pid=86461) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Full set of CONF: {{(pid=86461) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] ******************************************************************************** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Configuration options gathered from: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] ================================================================================ {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] allow_availability_zone_fallback = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86744]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] allow_compression_on_image_upload = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] allowed_direct_url_schemes = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] api_rate_limit = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] auth_strategy = keystone {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_host = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_stats_polling_interval = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backup_api_class = cinder.backup.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backup_name_template = backup-%s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backup_use_same_host = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backup_use_temp_snapshot = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] chap_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] chap_username = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_internal_tenant_project_id = 29ebe002263f45fab76bca45e9a46117 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_internal_tenant_user_id = 03f01e47b85b4ccb88f06b35b55f0abd {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cluster = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] compression_format = gzip {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] config_dir = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] config_source = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] control_exchange = openstack {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] debug = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] default_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] default_group_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] default_volume_type = QuobyteHD {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] disk_geometry = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] driver_client_cert = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] driver_client_cert_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] driver_data_namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] driver_ssl_cert_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] driver_ssl_cert_verify = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] driver_use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] enable_new_services = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] enable_unsupported_driver = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] enforce_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] filter_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_api_insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_api_ssl_compression = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_ca_certificates_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_num_retries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance_request_timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] goodness_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] graceful_shutdown_timeout = 5 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] group_api_class = cinder.group.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] host = devstack {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_compress_on_upload = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_conversion_address_space_limit = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_conversion_cpu_limit = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_conversion_disable = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_introspection_address_space_limit = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_introspection_cpu_limit = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_upload_use_cinder_backend = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_upload_use_internal_tenant = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_volume_cache_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_volume_cache_max_count = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] init_host_max_objects_retrieval = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] instance_format = [instance: %(uuid)s] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] iscsi_target_flags = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] iscsi_write_cache = on {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] iser_helper = tgtadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] iser_ip_address = 192.168.122.196 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] iser_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.remotefs [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86744) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_color = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_config_append = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_dir = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_options = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_rotate_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_rotate_interval_type = days {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] log_rotation_type = none {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] max_age = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] max_logfile_count = 30 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] max_logfile_size_mb = 200 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] max_over_subscription_ratio = 20.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] message_reap_interval = 86400 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] message_ttl = 2592000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] monkey_patch = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] monkey_patch_modules = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] my_ip = 192.168.122.196 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] no_snapshot_gb_quota = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] num_iser_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] num_shell_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] num_volume_device_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] nvmeof_conn_info_version = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] nvmet_ns_id = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] nvmet_port_id = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] osapi_max_limit = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] osapi_volume_ext_list = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] osapi_volume_listen_port = 8776 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] osapi_volume_use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] osapi_volume_workers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] per_volume_size_limit = -1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] periodic_fuzzy_delay = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] periodic_interval = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] public_endpoint = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] publish_errors = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] quota_backup_gigabytes = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] quota_backups = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] quota_gigabytes = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] quota_groups = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] quota_snapshots = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] quota_volumes = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] rate_limit_burst = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] rate_limit_except_level = CRITICAL {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] rate_limit_interval = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] reinit_driver_count = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] replication_device = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] report_discard_supported = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] report_interval = 120 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] reservation_clean_interval = 86400 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] reservation_expire = 86400 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] reserved_image_namespaces = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] reserved_percentage = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] rpc_response_timeout = 120 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] run_external_periodic_tasks = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] scst_target_driver = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] scst_target_iqn_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_down_time = 720 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] shell_completion = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] snapshot_name_template = snapshot-%s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] state_path = /opt/stack/data/cinder {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] storage_availability_zone = nova {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] storage_protocol = iSCSI {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] syslog_log_facility = LOG_USER {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] target_helper = lioadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] target_ip_address = 192.168.122.196 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] target_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] target_protocol = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] target_secondary_ip_addresses = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] trace_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] transport_url = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] until_refresh = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] use_chap_auth = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] use_default_quota_class = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] use_journal = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] use_json = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] use_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] use_stderr = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] use_syslog = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] verify_glance_signatures = enabled {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_api_class = cinder.volume.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_backend_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_clear = zero {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_clear_ionice = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_clear_size = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_copy_bps_limit = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_dd_blocksize = 1M {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_name_template = volume-%s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_service_inithost_offload = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volume_usage_audit_period = month {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] zoning_mode = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.auth_type = password {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.auth_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.cache = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.interface = public {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcache_username = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.region_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.service_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.backend = dogpile.cache.null {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86744) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 16:03:11 devstack cinder-volume[86744]: WARNING cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 16:03:11 devstack cinder-volume[86744]: WARNING cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.backend_argument = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.backend_expiration_time = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.config_prefix = cache.oslo {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Running cmd (subprocess): mount.quobyte {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.debug_cache_backend = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.enable_retry_client = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.enable_socket_keepalive = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.expiration_time = 600 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.memcache_dead_retry = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.memcache_sasl_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.proxies = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.redis_db = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.redis_server = localhost:6379 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.retry_attempts = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.retry_delay = 0.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.socket_keepalive_count = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.socket_keepalive_idle = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.socket_keepalive_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.socket_timeout = 1.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.tls_allowed_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.tls_cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.tls_certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.tls_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.tls_keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cache.username = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] coordination.backend_url = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.asyncio_connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.asyncio_slave_connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.backend = sqlalchemy {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.connection_debug = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.connection_parameters = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.connection_recycle_time = 3600 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.connection_trace = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.db_inc_retry_interval = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.db_max_retries = 20 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.db_max_retry_interval = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.db_retry_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.max_overflow = 50 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.max_pool_size = 5 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.max_retries = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.pool_timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.retry_interval = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.slave_connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.sqlite_synchronous = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.synchronous_reader = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] database.use_db_reconnect = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_tracing.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.connection_string = messaging:// {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.es_doc_type = notification {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.es_scroll_size = 10000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.es_scroll_time = 2m {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.filter_error_trace = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.hmac_keys = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.sentinel_service_name = mymaster {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.socket_timeout = 0.1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.trace_requests = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler.trace_sqlalchemy = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler_jaeger.process_tags = {} {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] profiler_otlp.service_name_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.policy_default_rule = default {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] privsep_osbrick.group = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] privsep_osbrick.helper_command = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=86744) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:11 devstack cinder-volume[86744]: INFO cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 ... Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb -c /etc/quobyte/client-cinder.cfg {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] privsep_osbrick.user = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_sys_admin.group = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_sys_admin.helper_command = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] cinder_sys_admin.user = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.auth_type = password {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.send_service_user_token = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.tls_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] service_user.tls_min_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.auth_type = password {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.region_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.tls_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] glance.tls_min_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.backend_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.chap_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.chap_username = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.disk_geometry = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.driver_client_cert = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.driver_data_namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.driver_use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.extra_capabilities = {} {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.filter_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.goodness_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb -c /etc/quobyte/client-cinder.cfg Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.iscsi_target_flags = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.iser_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_host = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_login = admin {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_mount_options = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_private_key = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_share_path = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.replication_device = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.report_discard_supported = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.target_helper = tgtadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.target_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.target_protocol = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.trace_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.use_chap_auth = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_backend_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_clear = zero {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_reports.file_event_handler = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_reports.log_dir = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.backend_host = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.chap_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.chap_username = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.disk_geometry = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.driver_client_cert = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.extra_capabilities = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.filter_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.goodness_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.iser_helper = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.iser_ip_address = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.iser_port = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_host = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_login = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_mount_options = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_private_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_share_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.num_shell_tries = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.replication_device = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.report_discard_supported = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.reserved_percentage = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.scst_target_driver = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.storage_protocol = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.target_helper = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.target_ip_address = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.target_port = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.target_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.target_protocol = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.trace_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.use_chap_auth = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_clear = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_clear_size = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] QuobyteHD.volumes_dir = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_notifications.driver = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] key_manager.fixed_key = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.barbican_api_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.barbican_endpoint = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.barbican_endpoint_type = public {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.barbican_region_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.number_of_retries = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.retry_delay = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.send_service_user_token = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.tls_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.tls_min_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.verify_ssl = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican.verify_ssl_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.auth_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.tls_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] barbican_service_user.tls_min_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.approle_role_id = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.approle_secret_id = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.auth_method = approle {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.auth_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.kv_mountpoint = secret {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.kv_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.kv_version = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.root_token_id = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.ssl_ca_crt_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.timeout = 60.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.token_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.token_role = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:11 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] ******************************************************************************** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:03:11 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.572s {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:11 devstack cinder-volume[86744]: INFO cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 succeeded Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=86744) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.587s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:11 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:11 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:03:11 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:12 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.276s {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:12 devstack cinder-volume[86744]: INFO cinder.volume.driver [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.volume.driver [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3252029418945, 'free_capacity_gb': 1775.3252029418945, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86744) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writer thread running {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.db.api [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Building query based on filter {{(pid=86744) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.image.image_utils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86744) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1322}} Sep 25 16:03:12 devstack cinder-volume[86744]: INFO cinder.keymgr.migration [None req-5b8b25b8-49a9-49d4-993e-f5aeb556be5a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=86744) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=86744) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:12 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:03:12 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:12 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.243s {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.manager [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Notifying Schedulers of capabilities ... {{(pid=86744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:12 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Driver initialization completed successfully. Sep 25 16:03:12 devstack cinder-volume[86744]: INFO cinder.manager [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Initiating service 3 cleanup Sep 25 16:03:12 devstack cinder-volume[86744]: INFO cinder.manager [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Service 3 cleanup completed. Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.service [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Creating RPC server for service cinder-volume {{(pid=86744) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.service [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86744) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:03:12 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=86744) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=86744) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:12 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:12 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:03:12 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:13 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:13 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.302s {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:13 devstack cinder-volume[86744]: INFO cinder.volume.manager [None req-5c83bf7a-cecd-4770-8bd1-0504a54e6759 None None] Driver post RPC initialization completed successfully. Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-b4624262-410a-4af4-8869-8debda89021d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-b4624262-410a-4af4-8869-8debda89021d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-b4624262-410a-4af4-8869-8debda89021d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=86744) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG cinder.volume.drivers.quobyte [None req-b4624262-410a-4af4-8869-8debda89021d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=86744) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-b4624262-410a-4af4-8869-8debda89021d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86744) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-b4624262-410a-4af4-8869-8debda89021d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:18 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:03:18 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:18 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG oslo_concurrency.processutils [None req-b4624262-410a-4af4-8869-8debda89021d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.269s {{(pid=86744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:18 devstack cinder-volume[86744]: DEBUG cinder.manager [None req-b4624262-410a-4af4-8869-8debda89021d None None] Notifying Schedulers of capabilities ... {{(pid=86744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:21 devstack cinder-volume[86461]: DEBUG dbcounter [-] [86461] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:21 devstack cinder-volume[86461]: INFO oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Caught SIGTERM, stopping children Sep 25 16:03:21 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Acquiring lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:21 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Acquired lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:21 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Releasing lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:21 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Stop services. {{(pid=86461) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 16:03:21 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Killing children. {{(pid=86461) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 16:03:21 devstack cinder-volume[86461]: INFO oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Waiting on 1 children to exit Sep 25 16:03:23 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writing DB stats cinder:SELECT=4 {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:23 devstack cinder-volume[86744]: DEBUG dbcounter [-] [86744] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:25 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Acquiring lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:25 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Acquired lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:25 devstack cinder-volume[86744]: DEBUG oslo_concurrency.lockutils [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Releasing lock "singleton_lock" {{(pid=86744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:25 devstack cinder-volume[86744]: WARNING amqp [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:03:26 devstack cinder-volume[86744]: WARNING amqp [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:03:26 devstack cinder-volume[86461]: INFO oslo_service.backend._eventlet.service [None req-d1d08e32-d6fc-41d5-b2b0-f6cc8ef833f3 None None] Child 86744 exited with status 0 Sep 25 16:03:26 devstack cinder-volume[87208]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:03:26 devstack cinder-volume[87208]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:03:26 devstack cinder-volume[87208]: we strongly recommend against using it for new projects. Sep 25 16:03:26 devstack cinder-volume[87208]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:03:26 devstack cinder-volume[87208]: framework. For more detail see Sep 25 16:03:26 devstack cinder-volume[87208]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:03:26 devstack cinder-volume[87208]: import eventlet # noqa Sep 25 16:03:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:03:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:03:29 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:03:30 devstack cinder-volume[87208]: INFO dbcounter [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Registered counter for database cinder Sep 25 16:03:30 devstack cinder-volume[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:30 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writer thread running {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:30 devstack cinder-volume[87208]: INFO cinder.rpc [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:03:30 devstack cinder-volume[87208]: INFO cinder.rpc [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:03:30 devstack cinder-volume[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Determined volume DB was empty at startup. Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87208) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:03:31 devstack cinder-volume[87208]: WARNING stevedore.named [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:03:31 devstack cinder-volume[87208]: WARNING castellan.key_manager [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:31 devstack cinder-volume[87208]: WARNING cinder.keymgr.conf_key_mgr [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:03:31 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:31 devstack cinder-volume[87208]: INFO oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Starting 1 workers Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Started child 87467 {{(pid=87208) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Full set of CONF: {{(pid=87208) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] ******************************************************************************** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] Configuration options gathered from: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] ================================================================================ {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:03:31 devstack cinder-volume[87467]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] allow_availability_zone_fallback = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] allow_compression_on_image_upload = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] allowed_direct_url_schemes = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] api_rate_limit = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] auth_strategy = keystone {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_host = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_stats_polling_interval = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backup_api_class = cinder.backup.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backup_name_template = backup-%s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backup_use_same_host = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backup_use_temp_snapshot = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] chap_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] chap_username = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_internal_tenant_project_id = 29ebe002263f45fab76bca45e9a46117 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_internal_tenant_user_id = 03f01e47b85b4ccb88f06b35b55f0abd {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cluster = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] compression_format = gzip {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] compute_api_class = cinder.compute.nova.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] config_dir = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] config_source = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] control_exchange = openstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] debug = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] default_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] default_group_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] default_volume_type = QuobyteHD {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] disk_geometry = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] driver_client_cert = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] driver_client_cert_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] driver_data_namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] driver_ssl_cert_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] driver_ssl_cert_verify = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] driver_use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] enable_new_services = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] enable_unsupported_driver = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] enabled_backends = ['QuobyteHD'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] enforce_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] filter_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_api_insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_api_ssl_compression = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_ca_certificates_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_catalog_info = image:glance:publicURL {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_num_retries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance_request_timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] goodness_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] graceful_shutdown_timeout = 5 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] group_api_class = cinder.group.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] host = devstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_compress_on_upload = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_conversion_address_space_limit = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_conversion_cpu_limit = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_conversion_disable = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_introspection_address_space_limit = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_introspection_cpu_limit = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_upload_use_cinder_backend = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_upload_use_internal_tenant = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_volume_cache_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_volume_cache_max_count = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] image_volume_cache_max_size_gb = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] init_host_max_objects_retrieval = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] instance_format = [instance: %(uuid)s] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] iscsi_target_flags = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] iscsi_write_cache = on {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] iser_helper = tgtadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] iser_ip_address = 192.168.122.196 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] iser_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87467) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_color = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_config_append = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_dir = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_options = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_rotate_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_rotate_interval_type = days {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] log_rotation_type = none {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] max_age = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] max_logfile_count = 30 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] max_logfile_size_mb = 200 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] max_over_subscription_ratio = 20.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] message_reap_interval = 86400 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] message_ttl = 2592000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] migration_create_volume_timeout_secs = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] monkey_patch = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] monkey_patch_modules = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] my_ip = 192.168.122.196 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] no_snapshot_gb_quota = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] num_iser_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] num_shell_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] num_volume_device_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] nvmeof_conn_info_version = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] nvmet_ns_id = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] nvmet_port_id = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] osapi_max_limit = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] osapi_volume_ext_list = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] osapi_volume_listen = 0.0.0.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] osapi_volume_listen_port = 8776 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] osapi_volume_use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] osapi_volume_workers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] per_volume_size_limit = -1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] periodic_fuzzy_delay = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] periodic_interval = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] project_id_regex = [0-9a-f\-]+ {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] public_endpoint = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] publish_errors = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] quota_backup_gigabytes = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] quota_backups = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] quota_gigabytes = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] quota_groups = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] quota_snapshots = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] quota_volumes = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] rate_limit_burst = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] rate_limit_except_level = CRITICAL {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] rate_limit_interval = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] reinit_driver_count = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] replication_device = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] report_discard_supported = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] report_interval = 120 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] reservation_clean_interval = 86400 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] reservation_expire = 86400 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] reserved_image_namespaces = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] reserved_percentage = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] rpc_response_timeout = 120 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] run_external_periodic_tasks = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] scst_target_driver = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] scst_target_iqn_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_down_time = 720 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] shell_completion = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] snapshot_name_template = snapshot-%s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] state_path = /opt/stack/data/cinder {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] storage_availability_zone = nova {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] storage_protocol = iSCSI {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] syslog_log_facility = LOG_USER {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] target_helper = lioadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] target_ip_address = 192.168.122.196 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] target_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] target_protocol = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] target_secondary_ip_addresses = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] trace_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] transfer_api_class = cinder.transfer.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] transport_url = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] until_refresh = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] use_chap_auth = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] use_default_quota_class = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] use_journal = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] use_json = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] use_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] use_stderr = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] use_syslog = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] verify_glance_signatures = enabled {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_api_class = cinder.volume.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_backend_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_clear = zero {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_clear_ionice = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_clear_size = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_copy_bps_limit = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_dd_blocksize = 1M {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_name_template = volume-%s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_service_inithost_offload = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volume_usage_audit_period = month {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] zoning_mode = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_concurrency.disable_process_locking = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.auth_type = password {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.auth_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.cache = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.delay_auth_decision = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.http_connect_timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.include_service_catalog = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.interface = public {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcache_username = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.region_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87467) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.service_token_roles_required = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.service_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 16:03:31 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.token_cache_time = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.backend = dogpile.cache.null {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.backend_argument = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.backend_expiration_time = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.config_prefix = cache.oslo {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.debug_cache_backend = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Running cmd (subprocess): mount.quobyte {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.enable_retry_client = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.enable_socket_keepalive = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.expiration_time = 600 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.hashclient_retry_attempts = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.memcache_dead_retry = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.memcache_pool_maxsize = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.memcache_sasl_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.proxies = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.redis_db = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.redis_sentinel_service_name = mymaster {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.redis_server = localhost:6379 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.retry_attempts = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.retry_delay = 0.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.socket_keepalive_count = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.socket_keepalive_idle = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.socket_keepalive_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.socket_timeout = 1.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.tls_allowed_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.tls_cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.tls_certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.tls_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.tls_keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cache.username = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] coordination.backend_url = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.asyncio_connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.asyncio_slave_connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.backend = sqlalchemy {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.connection_debug = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.connection_parameters = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.connection_recycle_time = 3600 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.connection_trace = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.db_inc_retry_interval = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.db_max_retries = 20 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.db_max_retry_interval = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.db_retry_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.max_overflow = 50 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.max_pool_size = 5 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.max_retries = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.mysql_wsrep_sync_wait = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.pool_timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.retry_interval = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.slave_connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.sqlite_synchronous = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.synchronous_reader = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] database.use_db_reconnect = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_tracing.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.connection_string = messaging:// {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.es_doc_type = notification {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.es_scroll_size = 10000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.es_scroll_time = 2m {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.filter_error_trace = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.hmac_keys = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.sentinel_service_name = mymaster {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.socket_timeout = 0.1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.trace_requests = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler.trace_sqlalchemy = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler_jaeger.process_tags = {} {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler_jaeger.service_name_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] profiler_otlp.service_name_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.enforce_new_defaults = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.policy_default_rule = default {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.policy_file = policy.yaml {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_policy.remote_timeout = 60.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] privsep_osbrick.group = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] privsep_osbrick.helper_command = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] privsep_osbrick.user = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_sys_admin.group = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_sys_admin.helper_command = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] cinder_sys_admin.user = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.auth_type = password {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.send_service_user_token = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] service_user.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.auth_type = password {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.region_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] glance.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.backend_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.chap_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.chap_username = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.disk_geometry = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.driver_client_cert = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.driver_client_cert_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.driver_data_namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.driver_use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.enable_unsupported_driver = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.extra_capabilities = {} {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.filter_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.goodness_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack quobyte-client[87468]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 16:03:31 devstack quobyte-client[87468]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.iscsi_target_flags = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.iscsi_write_cache = on {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.iser_helper = tgtadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.iser_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_host = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_login = admin {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_mount_options = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_private_key = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_share_path = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_ssh_port = 22 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.num_shell_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.nvmet_port_id = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.quobyte_client_cfg = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.quobyte_volume_url = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.replication_device = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.report_discard_supported = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.reserved_percentage = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.scst_target_driver = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.scst_target_iqn_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.storage_protocol = iSCSI {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.target_helper = tgtadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.target_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.target_protocol = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.trace_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.unique_fqdn_network = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.use_chap_auth = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_backend_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_clear = zero {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_clear_ionice = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_clear_size = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_reports.file_event_handler = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_reports.log_dir = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.backend_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.backend_host = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.chap_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.chap_username = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.chiscsi_conf = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.disk_geometry = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.driver_client_cert = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.driver_client_cert_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.driver_data_namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.driver_use_ssl = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.extra_capabilities = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.filter_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.goodness_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.iscsi_target_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.iscsi_write_cache = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.iser_helper = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.iser_ip_address = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.iser_port = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.iser_target_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_host = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_login = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_mount_options = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_private_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_share_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_ssh_port = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.num_shell_tries = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nvmet_ns_id = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.nvmet_port_id = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.replication_device = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.report_discard_supported = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.reserved_percentage = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.scst_target_driver = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.storage_protocol = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.target_helper = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.target_ip_address = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.target_port = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.target_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.target_protocol = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.trace_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.unique_fqdn_network = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.use_chap_auth = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_clear = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_clear_ionice = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_clear_size = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] QuobyteHD.volumes_dir = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.ssl_version = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_notifications.driver = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_notifications.retry = -1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] key_manager.fixed_key = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.barbican_api_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.barbican_endpoint = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.barbican_endpoint_type = public {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.barbican_region_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.number_of_retries = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.retry_delay = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.send_service_user_token = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.verify_ssl = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican.verify_ssl_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.auth_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] barbican_service_user.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.approle_role_id = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.approle_secret_id = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.auth_method = approle {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.auth_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.kv_mountpoint = secret {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.kv_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.kv_version = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.root_token_id = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.ssl_ca_crt_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.timeout = 60.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.token_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.token_role = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:03:31 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-0e36e412-cc7e-498b-b0e9-c04fbb0b44ef None None] ******************************************************************************** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:03:31 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.246s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:31 devstack cinder-volume[87467]: INFO cinder.volume.driver [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.volume.driver [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3218307495117, 'free_capacity_gb': 1775.3218307495117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87467) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writer thread running {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.db.api [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Building query based on filter {{(pid=87467) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87467) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1322}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:31 devstack cinder-volume[87467]: INFO cinder.keymgr.migration [None req-feafafe4-4e95-4920-aa89-56c8a46eb708 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:03:31 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:03:31 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:31 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.243s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:03:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Driver initialization completed successfully. Sep 25 16:03:31 devstack cinder-volume[87467]: INFO cinder.manager [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Initiating service 3 cleanup Sep 25 16:03:32 devstack cinder-volume[87467]: INFO cinder.manager [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Service 3 cleanup completed. Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG cinder.service [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Creating RPC server for service cinder-volume {{(pid=87467) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG cinder.service [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87467) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:03:32 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:03:32 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:03:32 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:03:32 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Sep 25 16:03:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.251s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:03:32 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1aa718be-92f5-4fd7-bd80-cc4aec8af9ad None None] Driver post RPC initialization completed successfully. Sep 25 16:03:41 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=3 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:03:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:04:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:04:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 6 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:04:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Flow 'volume_create_manager' (28c1f758-c2dc-453a-8fb5-d55ac1363d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c16ee55-db16-465b-b738-b74369ed482d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c16ee55-db16-465b-b738-b74369ed482d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1893019811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58567e5a-3c17-4ae6-988c-c91e04f4a948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ffcc44dfba4ab2810465c700ce9854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:48Z,use_quota=True,user_id='0ca4e8e8ba1d409dbb1878d14577d12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c05c0d4-46eb-4ae8-9d89-f044eb947766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c05c0d4-46eb-4ae8-9d89-f044eb947766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794df7a2-36f2-4f9f-a8b1-6db6e7c721e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794df7a2-36f2-4f9f-a8b1-6db6e7c721e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58567e5a-3c17-4ae6-988c-c91e04f4a948', 'volume_name': 'volume-58567e5a-3c17-4ae6-988c-c91e04f4a948', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c559c5-7a4c-4dc5-8ce2-7f222f1d94f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c559c5-7a4c-4dc5-8ce2-7f222f1d94f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2bae7-f4de-4a00-9965-50de13a684b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:47 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Volume 58567e5a-3c17-4ae6-988c-c91e04f4a948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58567e5a-3c17-4ae6-988c-c91e04f4a948', 'volume_size': 1} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1893019811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58567e5a-3c17-4ae6-988c-c91e04f4a948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ffcc44dfba4ab2810465c700ce9854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:04:48Z,use_quota=True,user_id='0ca4e8e8ba1d409dbb1878d14577d12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Creating volume 58567e5a-3c17-4ae6-988c-c91e04f4a948 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:04:47 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:04:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:47 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 1073741824 Sep 25 16:04:47 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:48 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 1073741824" returned: 0 in 0.665s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:04:48 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 Sep 25 16:04:48 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:04:48 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Sep 25 16:04:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948" returned: 0 in 0.354s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:04:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:04:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:04:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2bae7-f4de-4a00-9965-50de13a684b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58567e5a-3c17-4ae6-988c-c91e04f4a948', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4165c787-916b-4483-854e-f57088b7dbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:04:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Volume volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 (58567e5a-3c17-4ae6-988c-c91e04f4a948): created successfully Sep 25 16:04:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4165c787-916b-4483-854e-f57088b7dbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:04:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Flow 'volume_create_manager' (28c1f758-c2dc-453a-8fb5-d55ac1363d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:04:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-85f3d70b-55b8-421d-9081-e068be85fbc3 tempest-TaggedAttachmentsTest-1535456247 None] Created volume successfully. Sep 25 16:04:59 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:04:59 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Flow 'volume_create_manager' (7548a1f9-64aa-4d8a-8b43-138d27f05cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb114d69-289a-40cf-82d0-4cba06767dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb114d69-289a-40cf-82d0-4cba06767dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1624953755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2c9060-6f15-416d-ab3d-33dfb33c0090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81bd021691e41509a6e72783847a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:13Z,use_quota=True,user_id='b3f6324ff24e409da1799da3df290901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3239396-113e-41d8-adaa-1a5f6126d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3239396-113e-41d8-adaa-1a5f6126d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6136bcb4-9a45-4dd4-9759-2397dfb5ee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6136bcb4-9a45-4dd4-9759-2397dfb5ee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2c9060-6f15-416d-ab3d-33dfb33c0090', 'volume_name': 'volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df82055-a529-436d-a983-09cd04e957dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df82055-a529-436d-a983-09cd04e957dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fed20e2-a608-4f64-804e-7979c02fa398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:12 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Volume 7b2c9060-6f15-416d-ab3d-33dfb33c0090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090', 'volume_size': 1} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1624953755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2c9060-6f15-416d-ab3d-33dfb33c0090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81bd021691e41509a6e72783847a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:13Z,use_quota=True,user_id='b3f6324ff24e409da1799da3df290901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Creating volume 7b2c9060-6f15-416d-ab3d-33dfb33c0090 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:12 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:05:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:12 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 1073741824 Sep 25 16:05:12 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:13 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 1073741824" returned: 0 in 1.158s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:14 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 Sep 25 16:05:14 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:14 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090" returned: 0 in 0.601s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fed20e2-a608-4f64-804e-7979c02fa398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f75f7bc-c1df-48d7-8e92-b7d0ecc8aff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:14 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Volume volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 (7b2c9060-6f15-416d-ab3d-33dfb33c0090): created successfully Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f75f7bc-c1df-48d7-8e92-b7d0ecc8aff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Flow 'volume_create_manager' (7548a1f9-64aa-4d8a-8b43-138d27f05cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:14 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1b7bc85f-794e-4611-83e9-88f0e6d4244b tempest-DeleteServersTestJSON-527306342 None] Created volume successfully. Sep 25 16:05:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:05:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:15 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:05:15 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:16 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.731s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:05:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 6 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:05:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:05:24 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:24 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:05:25 devstack cinder-volume[87467]: WARNING py.warnings [req-d1206819-5427-461e-bded-c89ee3ed68aa req-c566ed33-26df-47d8-86dc-db38e99dbc36 tempest-DeleteServersTestJSON-527306342 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 25 16:05:25 devstack cinder-volume[87467]: .first() Sep 25 16:05:25 devstack cinder-volume[87467]: Sep 25 16:05:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-d1206819-5427-461e-bded-c89ee3ed68aa req-c566ed33-26df-47d8-86dc-db38e99dbc36 tempest-DeleteServersTestJSON-527306342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-d1206819-5427-461e-bded-c89ee3ed68aa req-c566ed33-26df-47d8-86dc-db38e99dbc36 tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-d1206819-5427-461e-bded-c89ee3ed68aa req-c566ed33-26df-47d8-86dc-db38e99dbc36 tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-d1206819-5427-461e-bded-c89ee3ed68aa req-c566ed33-26df-47d8-86dc-db38e99dbc36 tempest-DeleteServersTestJSON-527306342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37383394-7232-43eb-9148-950df74d1854', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:05:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-d1206819-5427-461e-bded-c89ee3ed68aa req-c566ed33-26df-47d8-86dc-db38e99dbc36 tempest-DeleteServersTestJSON-527306342 None] attachment_update completed successfully. Sep 25 16:05:25 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Flow 'volume_create_manager' (990bbc1c-2a53-4bb4-ae98-d6bb70b92128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b128b349-cda8-42c6-a874-dfacaa216e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b128b349-cda8-42c6-a874-dfacaa216e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1878916967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e017413-d2c3-43a2-8712-a53e72aae9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef90cf28fb54fe8827da297ba96e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:26Z,use_quota=True,user_id='e462430929f6439796da143e4268b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8456535-5f79-4ffc-bda8-a07131cf9608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8456535-5f79-4ffc-bda8-a07131cf9608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaa27b9-37ff-41d4-a641-e63801445519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaa27b9-37ff-41d4-a641-e63801445519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e017413-d2c3-43a2-8712-a53e72aae9a4', 'volume_name': 'volume-3e017413-d2c3-43a2-8712-a53e72aae9a4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36c4c0a-57f4-41a0-8a7c-d41d09a7abbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36c4c0a-57f4-41a0-8a7c-d41d09a7abbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffedf810-8776-4df9-88f5-a4ed1dc3aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:26 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Volume 3e017413-d2c3-43a2-8712-a53e72aae9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e017413-d2c3-43a2-8712-a53e72aae9a4', 'volume_size': 1} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1878916967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e017413-d2c3-43a2-8712-a53e72aae9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ef90cf28fb54fe8827da297ba96e48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:26Z,use_quota=True,user_id='e462430929f6439796da143e4268b542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Creating volume 3e017413-d2c3-43a2-8712-a53e72aae9a4 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:26 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:05:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:26 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 1073741824 Sep 25 16:05:26 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:27 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 1073741824" returned: 0 in 1.753s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:28 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 Sep 25 16:05:28 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:28 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4" returned: 0 in 0.661s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] <== create_volume: return (2512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.518s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffedf810-8776-4df9-88f5-a4ed1dc3aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e017413-d2c3-43a2-8712-a53e72aae9a4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91927535-a0e6-4b9a-8b8e-109d735b386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Volume volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 (3e017413-d2c3-43a2-8712-a53e72aae9a4): created successfully Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91927535-a0e6-4b9a-8b8e-109d735b386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Flow 'volume_create_manager' (990bbc1c-2a53-4bb4-ae98-d6bb70b92128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1a5bff93-0a01-41a5-bd40-80df3b024068 tempest-VolumesAdminNegativeTest-548280035 None] Created volume successfully. Sep 25 16:05:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Acquiring lock "cinder-3e017413-d2c3-43a2-8712-a53e72aae9a4-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Lock "cinder-3e017413-d2c3-43a2-8712-a53e72aae9a4-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Acquiring lock "cinder-quobyte-3e017413-d2c3-43a2-8712-a53e72aae9a4" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Lock "cinder-quobyte-3e017413-d2c3-43a2-8712-a53e72aae9a4" acquired by "delete_volume" :: waited 0.069s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:31 devstack cinder-volume[87467]: INFO oslo.privsep.daemon [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb2vsu8d_/privsep.sock'] Sep 25 16:05:31 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb2vsu8d_/privsep.sock Sep 25 16:05:31 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 16:05:34 devstack cinder-volume[87467]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 16:05:34 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:34 devstack cinder-volume[87467]: INFO oslo.privsep.daemon [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Spawned new privsep daemon via rootwrap Sep 25 16:05:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Accepted privsep connection to /tmp/tmpb2vsu8d_/privsep.sock {{(pid=87467) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 16:05:34 devstack cinder-volume[87467]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 16:05:34 devstack cinder-volume[87467]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 16:05:34 devstack cinder-volume[87467]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 16:05:34 devstack cinder-volume[87467]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89060 Sep 25 16:05:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ff9e7e-466c-443e-829a-d7b59b39d127]: (2,) {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13191d6-1f80-4317-8998-4e6e80ee952e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:35 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 Sep 25 16:05:35 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:35 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4" returned: 0 in 0.856s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:35 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4 Sep 25 16:05:35 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:36 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e017413-d2c3-43a2-8712-a53e72aae9a4" returned: 0 in 0.859s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Lock "cinder-quobyte-3e017413-d2c3-43a2-8712-a53e72aae9a4" released by "delete_volume" :: held 5.168s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:36 devstack cinder-volume[87467]: WARNING cinder.quota [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:05:36 devstack cinder-volume[87467]: WARNING cinder.quota [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Created reservations ['a11bd9b5-1bb1-48ae-b83f-35f387e4b263', 'f3697c7d-4b33-4d1e-be9a-fad4cb047ece', '33cad938-0619-4c2c-a5c9-0c784126faaf', '2d134a5b-d340-4b47-ad2d-1f507c7f8030'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:36 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:05:36 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-ba0bdc41-69a9-4bc5-914b-3f16b49e514c req-baa019da-fa7d-494a-8cdd-d768ca81875c tempest-DeleteServersTestJSON-527306342 None] Terminate volume connection completed successfully. Sep 25 16:05:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-ba0bdc41-69a9-4bc5-914b-3f16b49e514c req-baa019da-fa7d-494a-8cdd-d768ca81875c tempest-DeleteServersTestJSON-527306342 None] Deleting attachment 37383394-7232-43eb-9148-950df74d1854. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:05:37 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 1.018s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:37 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Deleted volume successfully. Sep 25 16:05:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-edabc606-9f97-4693-8487-63e3222969bc tempest-VolumesAdminNegativeTest-548280035 None] Lock "cinder-3e017413-d2c3-43a2-8712-a53e72aae9a4-delete_volume" released by "delete_volume" :: held 6.976s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Acquiring lock "cinder-7b2c9060-6f15-416d-ab3d-33dfb33c0090-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Lock "cinder-7b2c9060-6f15-416d-ab3d-33dfb33c0090-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Acquiring lock "cinder-quobyte-7b2c9060-6f15-416d-ab3d-33dfb33c0090" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Lock "cinder-quobyte-7b2c9060-6f15-416d-ab3d-33dfb33c0090" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:40 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[49553f4b-60c7-4050-bd11-9633d7e1277d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:41 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 Sep 25 16:05:41 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:41 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090" returned: 0 in 0.891s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:41 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090 Sep 25 16:05:41 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:42 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7b2c9060-6f15-416d-ab3d-33dfb33c0090" returned: 0 in 0.423s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Lock "cinder-quobyte-7b2c9060-6f15-416d-ab3d-33dfb33c0090" released by "delete_volume" :: held 1.427s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Created reservations ['1a280332-7067-4af8-973e-07baba58b2b7', 'b9b02dda-f215-44b9-9dc2-4cd27fe2d81d', 'de12759d-0e0d-4ab3-80e4-1f54b1afec5b', '605bee41-f862-4654-95c8-2497dd3019fa'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:42 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:05:42 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:42 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.398s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Deleted volume successfully. Sep 25 16:05:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-18a0ac6f-1de2-468e-97ab-7cea70ff5c00 tempest-DeleteServersTestJSON-527306342 None] Lock "cinder-7b2c9060-6f15-416d-ab3d-33dfb33c0090-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6678d3ab-7bfb-4606-b955-7cbb3d7c2f31 tempest-GroupsTest-1767084278 None] Group tempest-Group1-645424239: creating Sep 25 16:05:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6678d3ab-7bfb-4606-b955-7cbb3d7c2f31 tempest-GroupsTest-1767084278 None] Group tempest-Group1-645424239: created successfully Sep 25 16:05:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6678d3ab-7bfb-4606-b955-7cbb3d7c2f31 tempest-GroupsTest-1767084278 None] Create group completed successfully. Sep 25 16:05:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f4ab82db-b3c6-4820-88f4-8b70a5554b1b tempest-GroupsTest-1767084278 None] Group tempest-Group2-1005483924: creating Sep 25 16:05:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f4ab82db-b3c6-4820-88f4-8b70a5554b1b tempest-GroupsTest-1767084278 None] Group tempest-Group2-1005483924: created successfully Sep 25 16:05:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f4ab82db-b3c6-4820-88f4-8b70a5554b1b tempest-GroupsTest-1767084278 None] Create group completed successfully. Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Flow 'volume_create_manager' (3d04324b-f94f-4346-acb9-606fecebd0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d450bf-3e0c-4790-bff4-43b3809b5c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d450bf-3e0c-4790-bff4-43b3809b5c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494668534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aabb7c01-bcd2-4727-a32c-733213a1e4cd,host='devstack@QuobyteHD#QuobyteHD',id=87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b16b19209cf4207b3e7a1037a261e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:50Z,use_quota=True,user_id='f930fc8fa91a4edaa7827a9ed2a6a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78f59bf1-e03d-49e7-965e-e0fb13c56f6a),volume_type_id=78f59bf1-e03d-49e7-965e-e0fb13c56f6a)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe796d8-5262-426e-89d4-288b0db3fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe796d8-5262-426e-89d4-288b0db3fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2947cc36-2e67-44fd-9126-0b01aa4ddbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2947cc36-2e67-44fd-9126-0b01aa4ddbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8', 'volume_name': 'volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4966e9c4-ece0-4ed2-a1d9-be8906e5020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4966e9c4-ece0-4ed2-a1d9-be8906e5020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cd68a7-c4b6-4b48-8414-3457d72e65ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Volume 87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8', 'volume_size': 1} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aabb7c01-bcd2-4727-a32c-733213a1e4cd,created_at=2026-09-25T14:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494668534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aabb7c01-bcd2-4727-a32c-733213a1e4cd,host='devstack@QuobyteHD#QuobyteHD',id=87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b16b19209cf4207b3e7a1037a261e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:05:50Z,use_quota=True,user_id='f930fc8fa91a4edaa7827a9ed2a6a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78f59bf1-e03d-49e7-965e-e0fb13c56f6a),volume_type_id=78f59bf1-e03d-49e7-965e-e0fb13c56f6a)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Creating volume 87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:05:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:50 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 1073741824 Sep 25 16:05:50 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:50 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 1073741824" returned: 0 in 0.527s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:50 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 Sep 25 16:05:50 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:51 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8" returned: 0 in 0.329s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:05:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cd68a7-c4b6-4b48-8414-3457d72e65ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91198d1-bd93-44ca-8a17-0d8d454ef3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:05:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Volume volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 (87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8): created successfully Sep 25 16:05:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91198d1-bd93-44ca-8a17-0d8d454ef3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:05:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Flow 'volume_create_manager' (3d04324b-f94f-4346-acb9-606fecebd0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:05:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-afa0ac78-1ea6-435a-a11e-f245a9e0f53a tempest-GroupsTest-1767084278 None] Created volume successfully. Sep 25 16:05:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Acquiring lock "cinder-quobyte-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:05:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Lock "cinder-quobyte-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:05:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa0c96c-ce62-43ff-b0c1-25ade188cf3e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:05:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:54 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 Sep 25 16:05:54 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:54 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8" returned: 0 in 0.568s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:54 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8 Sep 25 16:05:54 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:55 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8" returned: 0 in 0.385s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Lock "cinder-quobyte-87ff1bdf-9d9a-4f9a-83c0-250e8e8210f8" released by "delete_volume" :: held 1.054s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Created reservations ['b3b1f392-7076-4496-bd6e-190175d54abf'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:55 devstack cinder-volume[87467]: WARNING cinder.quota [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1316892866 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1316892866, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:05:55 devstack cinder-volume[87467]: WARNING cinder.quota [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1316892866 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1316892866, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Created reservations ['215ab980-217b-47a4-9a6d-d307e3a10f34', '3eb14909-ca9a-4b22-a7d9-db1cd94c6d04', '12f9fbe4-2675-4b0e-95d2-3bb11c8d9abe', '04e12bfa-a430-44be-9707-b0950527609f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:55 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:05:55 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:55 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.373s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:55 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-78464502-e12b-47b8-b03f-b4ead12e38b8 tempest-GroupsTest-1767084278 None] Delete group completed successfully. Sep 25 16:05:56 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Created reservations ['4a4d09ee-13fb-489b-a2f2-adfe30f7def5'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:05:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:05:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:05:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:05:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:05:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:05:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:05:57 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:05:57 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:05:57 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Sep 25 16:05:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.366s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:05:57 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:05:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8ae828a9-50e4-467d-8b0a-5b002beba1ff tempest-GroupsTest-1767084278 None] Delete group completed successfully. Sep 25 16:05:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-db0acc4d-12c2-4b2a-9b95-f9dc2fb59d0e tempest-GroupsTest-1767084278 None] Group tempest-GroupsTest-Group-1225046936: creating Sep 25 16:05:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-db0acc4d-12c2-4b2a-9b95-f9dc2fb59d0e tempest-GroupsTest-1767084278 None] Group tempest-GroupsTest-Group-1225046936: created successfully Sep 25 16:05:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-db0acc4d-12c2-4b2a-9b95-f9dc2fb59d0e tempest-GroupsTest-1767084278 None] Create group completed successfully. Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Flow 'volume_create_manager' (08a574b0-9d2d-4f1f-a7e5-b59049a34173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c9bacc-01b8-4d2b-97ea-f29fc50e8e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c9bacc-01b8-4d2b-97ea-f29fc50e8e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228348541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a248b96-8881-460a-8d91-ad20875df375,host='devstack@QuobyteHD#QuobyteHD',id=229e922a-c056-4a7e-9f3d-7ab257b0afef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b16b19209cf4207b3e7a1037a261e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:01Z,use_quota=True,user_id='f930fc8fa91a4edaa7827a9ed2a6a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dba0d299-d613-4f46-b358-dde272b6dc0a),volume_type_id=dba0d299-d613-4f46-b358-dde272b6dc0a)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06835e1d-03a3-4121-a434-b3bf217571a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06835e1d-03a3-4121-a434-b3bf217571a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c86e4c-68ab-48dc-94f5-c772d48bf3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c86e4c-68ab-48dc-94f5-c772d48bf3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229e922a-c056-4a7e-9f3d-7ab257b0afef', 'volume_name': 'volume-229e922a-c056-4a7e-9f3d-7ab257b0afef', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cf2bdc-bccb-4f1c-980c-4e8b7fea1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cf2bdc-bccb-4f1c-980c-4e8b7fea1457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9127da-3ec4-42cb-ad7d-e4c4d6965c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:00 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Volume 229e922a-c056-4a7e-9f3d-7ab257b0afef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229e922a-c056-4a7e-9f3d-7ab257b0afef', 'volume_size': 1} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a248b96-8881-460a-8d91-ad20875df375,created_at=2026-09-25T14:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228348541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a248b96-8881-460a-8d91-ad20875df375,host='devstack@QuobyteHD#QuobyteHD',id=229e922a-c056-4a7e-9f3d-7ab257b0afef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b16b19209cf4207b3e7a1037a261e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:01Z,use_quota=True,user_id='f930fc8fa91a4edaa7827a9ed2a6a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dba0d299-d613-4f46-b358-dde272b6dc0a),volume_type_id=dba0d299-d613-4f46-b358-dde272b6dc0a)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Creating volume 229e922a-c056-4a7e-9f3d-7ab257b0afef {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:00 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:06:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:00 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef 1073741824 Sep 25 16:06:00 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:01 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef 1073741824" returned: 0 in 0.659s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:01 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef Sep 25 16:06:01 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:01 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef" returned: 0 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9127da-3ec4-42cb-ad7d-e4c4d6965c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229e922a-c056-4a7e-9f3d-7ab257b0afef', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa056f62-6709-4516-b078-6df0a1bc9c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:01 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Volume volume-229e922a-c056-4a7e-9f3d-7ab257b0afef (229e922a-c056-4a7e-9f3d-7ab257b0afef): created successfully Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa056f62-6709-4516-b078-6df0a1bc9c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Flow 'volume_create_manager' (08a574b0-9d2d-4f1f-a7e5-b59049a34173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a468a97d-fc43-42a8-b3f0-0b658d84188d tempest-GroupsTest-1767084278 None] Created volume successfully. Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Flow 'volume_create_manager' (8d3ed422-c82a-4060-a53f-a1a2a555248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642c06f2-63cb-422b-94b1-1c870d7735ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642c06f2-63cb-422b-94b1-1c870d7735ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551461243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a248b96-8881-460a-8d91-ad20875df375,host='devstack@QuobyteHD#QuobyteHD',id=2fa34214-3acb-4a00-b1ff-0f08913634eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b16b19209cf4207b3e7a1037a261e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:04Z,use_quota=True,user_id='f930fc8fa91a4edaa7827a9ed2a6a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dba0d299-d613-4f46-b358-dde272b6dc0a),volume_type_id=dba0d299-d613-4f46-b358-dde272b6dc0a)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d8eb32-36a7-4065-858e-59181681959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d8eb32-36a7-4065-858e-59181681959a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bfe71a-ca3c-480e-8320-9ed7f3dbce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bfe71a-ca3c-480e-8320-9ed7f3dbce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa34214-3acb-4a00-b1ff-0f08913634eb', 'volume_name': 'volume-2fa34214-3acb-4a00-b1ff-0f08913634eb', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c937989d-c84e-41b0-b191-483c89746d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c937989d-c84e-41b0-b191-483c89746d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5337c5-d986-4f64-9fda-0bdd846a5787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:04 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Volume 2fa34214-3acb-4a00-b1ff-0f08913634eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa34214-3acb-4a00-b1ff-0f08913634eb', 'volume_size': 1} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a248b96-8881-460a-8d91-ad20875df375,created_at=2026-09-25T14:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551461243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a248b96-8881-460a-8d91-ad20875df375,host='devstack@QuobyteHD#QuobyteHD',id=2fa34214-3acb-4a00-b1ff-0f08913634eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b16b19209cf4207b3e7a1037a261e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:04Z,use_quota=True,user_id='f930fc8fa91a4edaa7827a9ed2a6a38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dba0d299-d613-4f46-b358-dde272b6dc0a),volume_type_id=dba0d299-d613-4f46-b358-dde272b6dc0a)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Creating volume 2fa34214-3acb-4a00-b1ff-0f08913634eb {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:04 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:06:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:04 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb 1073741824 Sep 25 16:06:04 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:05 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb 1073741824" returned: 0 in 0.720s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:05 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb Sep 25 16:06:05 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:05 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5337c5-d986-4f64-9fda-0bdd846a5787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa34214-3acb-4a00-b1ff-0f08913634eb', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd64038b-c2cf-447f-b0ea-140669d958cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:05 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Volume volume-2fa34214-3acb-4a00-b1ff-0f08913634eb (2fa34214-3acb-4a00-b1ff-0f08913634eb): created successfully Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd64038b-c2cf-447f-b0ea-140669d958cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Flow 'volume_create_manager' (8d3ed422-c82a-4060-a53f-a1a2a555248e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1a6d163a-400d-43c2-b04c-c6cf0e84b9af tempest-GroupsTest-1767084278 None] Created volume successfully. Sep 25 16:06:07 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2fff53c1-287c-4e0a-a2e7-704a0a0f3a70 tempest-GroupsTest-1767084278 None] Update group completed successfully. Sep 25 16:06:09 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f6c1d5b0-e443-4318-aaa9-efe1db0b1118 tempest-GroupsTest-1767084278 None] Update group completed successfully. Sep 25 16:06:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-0fe03bba-55c0-4827-9e7a-70afe74e5d23 req-faeaa534-210c-48f7-b8e2-5f46f7bd1844 tempest-TaggedAttachmentsTest-1535456247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-0fe03bba-55c0-4827-9e7a-70afe74e5d23 req-faeaa534-210c-48f7-b8e2-5f46f7bd1844 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-0fe03bba-55c0-4827-9e7a-70afe74e5d23 req-faeaa534-210c-48f7-b8e2-5f46f7bd1844 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-0fe03bba-55c0-4827-9e7a-70afe74e5d23 req-faeaa534-210c-48f7-b8e2-5f46f7bd1844 tempest-TaggedAttachmentsTest-1535456247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-58567e5a-3c17-4ae6-988c-c91e04f4a948', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a2834e4-6586-4dbb-bc1f-9400049ad3b0', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:06:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-0fe03bba-55c0-4827-9e7a-70afe74e5d23 req-faeaa534-210c-48f7-b8e2-5f46f7bd1844 tempest-TaggedAttachmentsTest-1535456247 None] attachment_update completed successfully. Sep 25 16:06:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Acquiring lock "cinder-quobyte-229e922a-c056-4a7e-9f3d-7ab257b0afef" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Lock "cinder-quobyte-229e922a-c056-4a7e-9f3d-7ab257b0afef" acquired by "delete_volume" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce244e-13d8-4d4e-a59c-fd3e20f350f6]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:12 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef Sep 25 16:06:12 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:13 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef" returned: 0 in 0.793s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:13 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef Sep 25 16:06:13 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:13 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-229e922a-c056-4a7e-9f3d-7ab257b0afef" returned: 0 in 0.585s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Lock "cinder-quobyte-229e922a-c056-4a7e-9f3d-7ab257b0afef" released by "delete_volume" :: held 1.518s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Acquiring lock "cinder-quobyte-2fa34214-3acb-4a00-b1ff-0f08913634eb" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Lock "cinder-quobyte-2fa34214-3acb-4a00-b1ff-0f08913634eb" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a8d64e-0a8b-45b0-86fa-2b394e95be80]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:14 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb Sep 25 16:06:14 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:14 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb" returned: 0 in 0.747s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:14 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb Sep 25 16:06:14 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:15 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2fa34214-3acb-4a00-b1ff-0f08913634eb" returned: 0 in 0.617s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Lock "cinder-quobyte-2fa34214-3acb-4a00-b1ff-0f08913634eb" released by "delete_volume" :: held 1.452s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:15 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:06:15 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Created reservations ['512c0f81-3d25-444a-9f23-7901faeb6336'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:15 devstack cinder-volume[87467]: WARNING cinder.quota [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-368256686 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-368256686, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:15 devstack cinder-volume[87467]: WARNING cinder.quota [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-368256686 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-368256686, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Created reservations ['01e70a28-0dff-4d24-85d7-6d0dc14bc090', '377bfd05-6350-425b-989f-57b1a0d76f9a', '2e8ac2db-d36f-4f96-979b-63427e67b801', '13413138-659a-4727-afb2-a32848ed5cdc'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Created reservations ['f8227c19-eaf0-4c3b-9a9a-1e0c82714117', '1975b4fa-01ff-459b-82a8-1d91042a8d28', 'e71ad4d5-81af-4a16-bdd8-4be7c1dd90cc', 'b2759625-41cd-479c-b1aa-607d1acd1f3c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:15 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.461s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 8 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:15 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:06:15 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:16 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d72d20c0-f053-4329-b7ef-f6dcc8d80f6b tempest-GroupsTest-1767084278 None] Delete group completed successfully. Sep 25 16:06:19 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-011ec6f5-2b57-4050-8f2d-3b5e56515807 req-c3145200-635a-4ba3-8c90-746c8df093c0 tempest-TaggedAttachmentsTest-1535456247 None] Terminate volume connection completed successfully. Sep 25 16:06:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-011ec6f5-2b57-4050-8f2d-3b5e56515807 req-c3145200-635a-4ba3-8c90-746c8df093c0 tempest-TaggedAttachmentsTest-1535456247 None] Deleting attachment 2a2834e4-6586-4dbb-bc1f-9400049ad3b0. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:06:29 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=69,cinder:UPDATE=72,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:06:29 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=68,cinder:UPDATE=64,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:06:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b23b04f0-a1a9-44b4-bb8c-cb696f88aa1f tempest-GroupsV320Test-992062732 None] Group tempest-GroupsV320Test-Group-30712487: creating Sep 25 16:06:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b23b04f0-a1a9-44b4-bb8c-cb696f88aa1f tempest-GroupsV320Test-992062732 None] Group tempest-GroupsV320Test-Group-30712487: created successfully Sep 25 16:06:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b23b04f0-a1a9-44b4-bb8c-cb696f88aa1f tempest-GroupsV320Test-992062732 None] Create group completed successfully. Sep 25 16:06:43 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Created reservations ['dab2a249-fdff-46de-b0c9-1cb96aa4aa31'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:43 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:06:43 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:44 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.701s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:44 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-41eee00d-19a3-41e3-98e6-0268fdda2aab tempest-GroupsV320Test-992062732 None] Delete group completed successfully. Sep 25 16:06:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Acquiring lock "cinder-58567e5a-3c17-4ae6-988c-c91e04f4a948-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Lock "cinder-58567e5a-3c17-4ae6-988c-c91e04f4a948-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Acquiring lock "cinder-quobyte-58567e5a-3c17-4ae6-988c-c91e04f4a948" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:06:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Lock "cinder-quobyte-58567e5a-3c17-4ae6-988c-c91e04f4a948" acquired by "delete_volume" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:06:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff86a774-c381-4e7b-a571-51bf01a30584]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:06:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:52 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 Sep 25 16:06:52 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:53 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948" returned: 0 in 0.993s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:53 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948 Sep 25 16:06:53 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Flow 'volume_create_manager' (f0e87640-c71e-4f0a-bb67-4e12bb33a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce13b4b-836c-4a94-895d-b3177c18b2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce13b4b-836c-4a94-895d-b3177c18b2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2078297050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721b8289-2e7b-4b88-a69e-c763a0c4bcdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c43366dbd24c7eaeba39fe5c99415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:54Z,use_quota=True,user_id='a2a551f33c4048c0954b9f6ecce918fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83f208a-6749-4794-8e78-a98952fe2269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83f208a-6749-4794-8e78-a98952fe2269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbb2e02-0cae-4a6a-a08e-e3f85592df0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbb2e02-0cae-4a6a-a08e-e3f85592df0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721b8289-2e7b-4b88-a69e-c763a0c4bcdd', 'volume_name': 'volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e3bb9a-661a-4ab2-97ce-d72d1a79e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e3bb9a-661a-4ab2-97ce-d72d1a79e502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3291574f-e365-43b3-9d8f-3db8a2ec98a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Volume 721b8289-2e7b-4b88-a69e-c763a0c4bcdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd', 'volume_size': 1} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:53 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2078297050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721b8289-2e7b-4b88-a69e-c763a0c4bcdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c43366dbd24c7eaeba39fe5c99415e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:06:54Z,use_quota=True,user_id='a2a551f33c4048c0954b9f6ecce918fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Creating volume 721b8289-2e7b-4b88-a69e-c763a0c4bcdd {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:06:53 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-58567e5a-3c17-4ae6-988c-c91e04f4a948" returned: 0 in 0.594s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:53 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd 1073741824 Sep 25 16:06:53 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Lock "cinder-quobyte-58567e5a-3c17-4ae6-988c-c91e04f4a948" released by "delete_volume" :: held 1.698s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Created reservations ['6a4ce44c-11d3-4b03-be4b-b763eb8dc737', 'a17f9ad8-5b38-4b72-8bab-d0215d0f47dc', 'abbc1544-b082-4aba-bc1e-5427767f31f5', 'f890d7fa-f832-4b21-87d4-a04e694ee986'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:54 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:06:54 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:54 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.640s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:06:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Deleted volume successfully. Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5db8bf7c-b09e-4037-a00f-7a869bd66c40 tempest-TaggedAttachmentsTest-1535456247 None] Lock "cinder-58567e5a-3c17-4ae6-988c-c91e04f4a948-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:06:54 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd 1073741824" returned: 0 in 1.149s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:06:55 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd Sep 25 16:06:55 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:06:55 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd" returned: 0 in 0.622s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3291574f-e365-43b3-9d8f-3db8a2ec98a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4067f034-2c39-48d0-b37c-99b4739df7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:06:55 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Volume volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd (721b8289-2e7b-4b88-a69e-c763a0c4bcdd): created successfully Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4067f034-2c39-48d0-b37c-99b4739df7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:06:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Flow 'volume_create_manager' (f0e87640-c71e-4f0a-bb67-4e12bb33a0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:06:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-91c9536f-72f4-401e-9dea-77287a358120 tempest-ServerRescueNegativeTestJSON-1247129622 None] Created volume successfully. Sep 25 16:07:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:07:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:07:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:07:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:15 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:07:15 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:16 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.744s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:17 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Flow 'volume_create_manager' (e361b7ac-48d0-40ad-a1e4-b7f9b37bb48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ad2713-36a0-423b-b4a5-63e209f2f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ad2713-36a0-423b-b4a5-63e209f2f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-881308403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75bfd99-bd4f-4721-8160-cc5bbd53c01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39059cea3694e2baa59f58b9fbc06a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:18Z,use_quota=True,user_id='936b77f168f14e3d9a1224e7fbf87e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b24abd6-f9af-4f12-8dbb-0a91faf972ae),volume_type_id=6b24abd6-f9af-4f12-8dbb-0a91faf972ae)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9500500-eeec-4e9a-8338-4e31fa515451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9500500-eeec-4e9a-8338-4e31fa515451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3710b4e4-1288-45d3-8d5c-06109f4edd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3710b4e4-1288-45d3-8d5c-06109f4edd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75bfd99-bd4f-4721-8160-cc5bbd53c01e', 'volume_name': 'volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588af85-fabd-4409-b68b-26671540c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588af85-fabd-4409-b68b-26671540c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1a0c68-1142-4835-901d-055a32945fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:18 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Volume b75bfd99-bd4f-4721-8160-cc5bbd53c01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e', 'volume_size': 1} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-881308403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75bfd99-bd4f-4721-8160-cc5bbd53c01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39059cea3694e2baa59f58b9fbc06a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:18Z,use_quota=True,user_id='936b77f168f14e3d9a1224e7fbf87e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b24abd6-f9af-4f12-8dbb-0a91faf972ae),volume_type_id=6b24abd6-f9af-4f12-8dbb-0a91faf972ae)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Creating volume b75bfd99-bd4f-4721-8160-cc5bbd53c01e {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:18 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:07:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:18 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e 1073741824 Sep 25 16:07:18 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:19 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e 1073741824" returned: 0 in 0.834s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:19 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e Sep 25 16:07:19 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:19 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e" returned: 0 in 0.441s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1a0c68-1142-4835-901d-055a32945fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98adfdba-bd03-4721-affb-821f1ecadc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:19 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Volume volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e (b75bfd99-bd4f-4721-8160-cc5bbd53c01e): created successfully Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98adfdba-bd03-4721-affb-821f1ecadc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Flow 'volume_create_manager' (e361b7ac-48d0-40ad-a1e4-b7f9b37bb48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:19 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-99bf085b-f6a5-4775-9650-cfe05b0b503d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Created volume successfully. Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:21 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:07:21 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:21 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.382s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:21 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-371a5e03-2f30-4893-a06d-5db61772ab17 tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Retype volume completed successfully. Sep 25 16:07:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Acquiring lock "cinder-721b8289-2e7b-4b88-a69e-c763a0c4bcdd-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "cinder-721b8289-2e7b-4b88-a69e-c763a0c4bcdd-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Acquiring lock "cinder-quobyte-721b8289-2e7b-4b88-a69e-c763a0c4bcdd" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "cinder-quobyte-721b8289-2e7b-4b88-a69e-c763a0c4bcdd" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c56844-3b6b-4072-b7f2-440bcb6fbadf]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Acquiring lock "cinder-b75bfd99-bd4f-4721-8160-cc5bbd53c01e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:22 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd Sep 25 16:07:22 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "cinder-b75bfd99-bd4f-4721-8160-cc5bbd53c01e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Acquiring lock "cinder-quobyte-b75bfd99-bd4f-4721-8160-cc5bbd53c01e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "cinder-quobyte-b75bfd99-bd4f-4721-8160-cc5bbd53c01e" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dced5b5-3806-416d-b427-7ee4d9c2637b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:23 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e Sep 25 16:07:23 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:23 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd" returned: 0 in 0.669s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:23 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd Sep 25 16:07:23 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:23 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e" returned: 0 in 0.648s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:23 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e Sep 25 16:07:23 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:24 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-721b8289-2e7b-4b88-a69e-c763a0c4bcdd" returned: 0 in 0.609s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "cinder-quobyte-721b8289-2e7b-4b88-a69e-c763a0c4bcdd" released by "delete_volume" :: held 1.365s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Created reservations ['2d2e2905-d8be-448b-84f8-08cab9294f6c', '1238f3eb-f201-4926-8e0d-f68218ed0ff5', '7c90d6b7-a4fd-4ae8-a67e-4ce28ad47edf', '1775ddf9-2ddd-42ca-9cbe-17b6137d1057'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:24 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:07:24 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:24 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b75bfd99-bd4f-4721-8160-cc5bbd53c01e" returned: 0 in 0.620s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "cinder-quobyte-b75bfd99-bd4f-4721-8160-cc5bbd53c01e" released by "delete_volume" :: held 1.371s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:24 devstack cinder-volume[87467]: WARNING cinder.quota [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:24 devstack cinder-volume[87467]: WARNING cinder.quota [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Created reservations ['567f7fad-ab90-41a2-9ffb-0b849faf34de', '1e19631f-d69b-4e2f-b2e4-b562115665ae', 'ed454705-6896-437d-82e8-0dc9ea184a77', 'b8e4762a-a42d-4dd4-be43-a0f912efcfac'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:24 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.345s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Deleted volume successfully. Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-26622361-8c2a-4624-8b48-d8f05bfdbf1d tempest-ServerRescueNegativeTestJSON-1247129622 None] Lock "cinder-721b8289-2e7b-4b88-a69e-c763a0c4bcdd-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:24 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:07:24 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:25 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.480s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:25 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Deleted volume successfully. Sep 25 16:07:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-600ea883-61a0-4982-bb26-3c9661c5a07d tempest-VolumeRetypeWithoutMigrationTest-674300395 None] Lock "cinder-b75bfd99-bd4f-4721-8160-cc5bbd53c01e-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Flow 'volume_create_manager' (ade78536-404d-4a59-aef8-97722da81aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdbb718-8d3e-45c9-92ed-c439f1da83d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdbb718-8d3e-45c9-92ed-c439f1da83d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1083135710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9848d61e3654f3a8f0fc8b9b592e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:38Z,use_quota=True,user_id='629815dec3b8418ab8a146d7ca7dc9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f01c72-192e-443d-ad4d-e0cb0820ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f01c72-192e-443d-ad4d-e0cb0820ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c41bea8-1937-4e19-8538-b697ae07912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c41bea8-1937-4e19-8538-b697ae07912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55', 'volume_name': 'volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ea80fd-8421-43cd-a020-1a92cfd21a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ea80fd-8421-43cd-a020-1a92cfd21a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b8fe63-84e3-46fe-ab96-c3bfa705515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:38 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Volume 29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55', 'volume_size': 1} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1083135710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9848d61e3654f3a8f0fc8b9b592e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:38Z,use_quota=True,user_id='629815dec3b8418ab8a146d7ca7dc9a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Creating volume 29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:38 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:07:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:38 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 1073741824 Sep 25 16:07:38 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:39 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 1073741824" returned: 0 in 0.754s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:39 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 Sep 25 16:07:39 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:39 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" returned: 0 in 0.435s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b8fe63-84e3-46fe-ab96-c3bfa705515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6007be-090c-4cc8-a42d-6b9f94ec585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:39 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Volume volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 (29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55): created successfully Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6007be-090c-4cc8-a42d-6b9f94ec585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Flow 'volume_create_manager' (ade78536-404d-4a59-aef8-97722da81aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-505a227a-3eb7-4697-aebf-1f2b19343d03 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Created volume successfully. Sep 25 16:07:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Creating offline snapshot 627083f7-75fc-4f47-ba2a-7da41bc8c354 of volume 29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:41 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b230aaf-ba6e-47af-bfdf-b5697e105eaa]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:41 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 Sep 25 16:07:41 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:41 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" returned: 0 in 0.899s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:42 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 1G Sep 25 16:07:42 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Flow 'volume_create_manager' (85def5a3-5dd6-4b40-8c73-00d1140629e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d77911-92ab-449d-a4c7-188370af0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d77911-92ab-449d-a4c7-188370af0ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1793433235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e9cdc4074d0480ddadc53279e67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:42Z,use_quota=True,user_id='51556457a738436ebd210e3e7c6d69ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec8be6e-83c7-4279-ac00-85fe9446a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec8be6e-83c7-4279-ac00-85fe9446a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff44392-52b4-4f9d-8e30-90d7d5f82618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff44392-52b4-4f9d-8e30-90d7d5f82618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2', 'volume_name': 'volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e07de36-900d-494f-b038-e516b5b265c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e07de36-900d-494f-b038-e516b5b265c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5943735f-4139-4e55-9a98-0caa7bac9394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:42 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Volume 0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2', 'volume_size': 1} Sep 25 16:07:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:43 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 1G" returned: 0 in 1.202s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:43 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 Sep 25 16:07:43 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:43 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354" returned: 0 in 0.398s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:43 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 is being set with open permissions: ugo+rw Sep 25 16:07:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:43 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 Sep 25 16:07:43 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:43 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354" returned: 0 in 0.360s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:44 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.info Sep 25 16:07:44 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:44 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.info" returned: 0 in 0.315s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:44 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.info is being set with open permissions: ugo+rw Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:44 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.info Sep 25 16:07:44 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:44 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.info" returned: 0 in 0.337s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.714s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.945s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1793433235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e9cdc4074d0480ddadc53279e67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:42Z,use_quota=True,user_id='51556457a738436ebd210e3e7c6d69ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Creating volume 0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:44 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:07:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:44 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 1073741824 Sep 25 16:07:44 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4657cb05-8575-4a25-afb0-69a3e2869aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Create snapshot completed successfully Sep 25 16:07:45 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 1073741824" returned: 0 in 0.613s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:45 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 Sep 25 16:07:45 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:45 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2" returned: 0 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5943735f-4139-4e55-9a98-0caa7bac9394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e0e11c-a452-4d9b-970d-330daf74d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:45 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Volume volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 (0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2): created successfully Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e0e11c-a452-4d9b-970d-330daf74d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Flow 'volume_create_manager' (85def5a3-5dd6-4b40-8c73-00d1140629e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:45 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-aed890cd-7d64-4fa1-b9a5-8cd984cfdd46 tempest-ServerActionsTestOtherA-620061493 None] Created volume successfully. Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "cinder-627083f7-75fc-4f47-ba2a-7da41bc8c354-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-627083f7-75fc-4f47-ba2a-7da41bc8c354-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "cinder-quobyte-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-quobyte-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "cinder-quobyte-627083f7-75fc-4f47-ba2a-7da41bc8c354" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-quobyte-627083f7-75fc-4f47-ba2a-7da41bc8c354" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Deleting offline snapshot 627083f7-75fc-4f47-ba2a-7da41bc8c354 of volume 29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] snapshot_file for this snap is: volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9345df-bb28-49a2-a67e-fa3fcf18f68f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:46 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 Sep 25 16:07:46 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:46 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354" returned: 0 in 0.644s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:07:47 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f591273-a8ef-49bf-ab00-52dbec3ba6a3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:47 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 Sep 25 16:07:47 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:47 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" returned: 0 in 0.678s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:47 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 Sep 25 16:07:47 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:48 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354" returned: 0 in 0.640s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:48 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354 Sep 25 16:07:48 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:48 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55.627083f7-75fc-4f47-ba2a-7da41bc8c354" returned: 0 in 0.394s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-quobyte-627083f7-75fc-4f47-ba2a-7da41bc8c354" released by "_delete_snapshot" :: held 2.626s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-quobyte-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" released by "delete_snapshot" :: held 2.661s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:49 devstack cinder-volume[87467]: WARNING cinder.quota [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Created reservations ['78160b10-be4b-4c74-8742-739a62da6991', '4e38765c-e1f1-434c-b5f2-9688db31fa98', 'a363ac2e-de68-42e8-9d81-486d7ce90547', 'be20c24d-523c-43f2-b952-0802d5631784'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Delete snapshot completed successfully. Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0fcbee61-8acd-4666-a9f5-a2e77f0ca3d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-627083f7-75fc-4f47-ba2a-7da41bc8c354-delete_snapshot" released by "delete_snapshot" :: held 3.014s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "cinder-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "cinder-quobyte-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-quobyte-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bdd773-a3ff-4974-be96-0cadadaece7f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:50 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 Sep 25 16:07:50 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:50 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" returned: 0 in 0.887s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:50 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55 Sep 25 16:07:50 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:51 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" returned: 0 in 0.561s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-quobyte-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55" released by "delete_volume" :: held 1.585s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Created reservations ['95e22808-2a39-4567-8537-436638ea8e16', '5ccf94a7-0c03-41dc-970d-dbc3733cce67', 'c754bc46-e47a-425b-92c3-490553e33b0e', 'f953b185-99bd-46fc-ac7c-15c370b7b470'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:51 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:07:51 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:52 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.347s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:52 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:07:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Deleted volume successfully. Sep 25 16:07:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-82dcfb77-f575-4458-af39-3448da58de28 tempest-VolumeSnapshotQuotasNegativeTestJSON-170599375 None] Lock "cinder-29ec4dd6-b5f5-490a-9cef-f4f0a7fefe55-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Flow 'volume_create_manager' (ea3dccdd-fa58-4bc7-96ed-ad6e3e25b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d930e59-4c50-4fd3-83c1-88afba90728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d930e59-4c50-4fd3-83c1-88afba90728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-899390854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa9dff-ca1a-49f9-9233-45a8e8461b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16f4261d0f640bc89980182c5ab968a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:55Z,use_quota=True,user_id='59ab4c38426a4660b43100f46978e2bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33d86a8-4b3f-4ca6-8175-78350fffb872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33d86a8-4b3f-4ca6-8175-78350fffb872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7a228a-c6f7-4620-b674-2bf6a273e3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7a228a-c6f7-4620-b674-2bf6a273e3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43aa9dff-ca1a-49f9-9233-45a8e8461b56', 'volume_name': 'volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09bf012-3f67-4d59-8eb4-1b55dfe9a320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09bf012-3f67-4d59-8eb4-1b55dfe9a320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa8ccb8-4fb5-4cbe-a19d-6a083bd146a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:55 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Volume 43aa9dff-ca1a-49f9-9233-45a8e8461b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56', 'volume_size': 1} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-899390854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa9dff-ca1a-49f9-9233-45a8e8461b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16f4261d0f640bc89980182c5ab968a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:07:55Z,use_quota=True,user_id='59ab4c38426a4660b43100f46978e2bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Creating volume 43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:07:55 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:07:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:55 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 1073741824 Sep 25 16:07:55 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:56 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 1073741824" returned: 0 in 0.888s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:07:56 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 Sep 25 16:07:56 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:07:56 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Sep 25 16:07:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56" returned: 0 in 0.481s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:07:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:07:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:07:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa8ccb8-4fb5-4cbe-a19d-6a083bd146a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875366d9-939a-4c16-94be-ff31068de2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:07:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Volume volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 (43aa9dff-ca1a-49f9-9233-45a8e8461b56): created successfully Sep 25 16:07:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875366d9-939a-4c16-94be-ff31068de2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:07:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Flow 'volume_create_manager' (ea3dccdd-fa58-4bc7-96ed-ad6e3e25b473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:07:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-a53e0cb6-bfe5-4cfc-94af-f87991d0fbdb req-9bc64267-b28d-418e-b230-85a5c496572a tempest-VolumesSnapshotsTestJSON-1849237000 None] Created volume successfully. Sep 25 16:07:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:07:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:07:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Creating offline snapshot d0cd3e59-53e1-47c1-833f-ddec3651e74e of volume 43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:07:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba77f3-748b-4ca4-a073-8430bf76f056]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:07:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:00 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 Sep 25 16:08:00 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:01 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56" returned: 0 in 1.549s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:01 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e 1G Sep 25 16:08:01 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:01 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e 1G" returned: 0 in 0.965s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:02 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e Sep 25 16:08:02 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:02 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e" returned: 0 in 0.644s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:02 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e is being set with open permissions: ugo+rw Sep 25 16:08:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:02 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e Sep 25 16:08:02 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:03 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e" returned: 0 in 1.051s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:03 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.info Sep 25 16:08:03 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:04 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.info" returned: 0 in 0.555s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:04 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.info is being set with open permissions: ugo+rw Sep 25 16:08:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:04 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.info Sep 25 16:08:04 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:05 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.info" returned: 0 in 0.925s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.999s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-14af5b4a-bb71-48b6-94e4-e4180810cc41 req-3c179fbd-b974-462c-9565-180e734758b1 tempest-VolumesSnapshotsTestJSON-1849237000 None] Create snapshot completed successfully Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "cinder-d0cd3e59-53e1-47c1-833f-ddec3651e74e-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-d0cd3e59-53e1-47c1-833f-ddec3651e74e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "cinder-quobyte-43aa9dff-ca1a-49f9-9233-45a8e8461b56" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-quobyte-43aa9dff-ca1a-49f9-9233-45a8e8461b56" acquired by "delete_snapshot" :: waited 0.093s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "cinder-quobyte-d0cd3e59-53e1-47c1-833f-ddec3651e74e" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-quobyte-d0cd3e59-53e1-47c1-833f-ddec3651e74e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Deleting offline snapshot d0cd3e59-53e1-47c1-833f-ddec3651e74e of volume 43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] snapshot_file for this snap is: volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8dbc4f-6c75-4e08-af28-5ed4939267db]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:06 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e Sep 25 16:08:06 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:07 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e" returned: 0 in 1.219s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:08:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c2778-91d7-4396-904e-137571df30d3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:08 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 Sep 25 16:08:08 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:09 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56" returned: 0 in 1.683s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:09 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e Sep 25 16:08:09 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:10 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e" returned: 0 in 0.829s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:10 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e Sep 25 16:08:10 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:10 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56.d0cd3e59-53e1-47c1-833f-ddec3651e74e" returned: 0 in 0.384s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-quobyte-d0cd3e59-53e1-47c1-833f-ddec3651e74e" released by "_delete_snapshot" :: held 4.419s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-quobyte-43aa9dff-ca1a-49f9-9233-45a8e8461b56" released by "delete_snapshot" :: held 4.474s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:11 devstack cinder-volume[87467]: DEBUG cinder.quota [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Created reservations ['b1361fa2-e7cb-486d-8845-92b3cbe9f813', 'cec09131-d3c8-48ed-a81b-061cee60f0a5', '972da35f-dea6-423c-9891-b4ccfdc9f7d2', '5a5bf186-51eb-4fa9-abe2-82705cb8245c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Delete snapshot completed successfully. Sep 25 16:08:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-24f192d7-242c-4f6c-b43f-90affe76d66f req-cc8fd553-5189-44d3-af00-89190ae9725e tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-d0cd3e59-53e1-47c1-833f-ddec3651e74e-delete_snapshot" released by "delete_snapshot" :: held 5.237s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "cinder-43aa9dff-ca1a-49f9-9233-45a8e8461b56-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-43aa9dff-ca1a-49f9-9233-45a8e8461b56-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "cinder-quobyte-43aa9dff-ca1a-49f9-9233-45a8e8461b56" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-quobyte-43aa9dff-ca1a-49f9-9233-45a8e8461b56" acquired by "delete_volume" :: waited 0.036s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:13 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[311e94cb-5d98-4492-9814-a3e44337e45a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:13 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 Sep 25 16:08:13 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:13 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56" returned: 0 in 0.688s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:13 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56 Sep 25 16:08:13 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:14 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-43aa9dff-ca1a-49f9-9233-45a8e8461b56" returned: 0 in 0.606s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-quobyte-43aa9dff-ca1a-49f9-9233-45a8e8461b56" released by "delete_volume" :: held 1.500s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:14 devstack cinder-volume[87467]: DEBUG cinder.quota [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Created reservations ['38820e13-c8a9-4893-bc89-0b11ebeea178', 'c26cee6a-cc04-4ffa-b867-521aa364a8eb', 'b47bd6b2-7f3e-4c9e-8949-dd9be960a98f', 'f65a195f-db41-4a7a-8998-320dea9f95d9'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:15 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:15 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:15 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:15 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:15 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.974s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG cinder.manager [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Deleted volume successfully. Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=54,cinder:UPDATE=68,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-4bca8c69-1c40-4f47-9765-85cdcd28c7dc req-19eb043a-ea1c-4f8f-96a5-679e834f7a94 tempest-VolumesSnapshotsTestJSON-1849237000 None] Lock "cinder-43aa9dff-ca1a-49f9-9233-45a8e8461b56-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:16 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 1.048s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 8 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:08:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:08:24 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=53,cinder:UPDATE=58,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Flow 'volume_create_manager' (ebebfe72-75d0-462c-ab88-8a10df9fc749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eae91d6-1a86-42c9-a8b6-febf12da0fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eae91d6-1a86-42c9-a8b6-febf12da0fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-512418919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e704254-0480-4150-baae-cde39ddae764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01b44f5faf23447abe108dfab3588c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:25Z,use_quota=True,user_id='244c553e3943450ea550ae493b0112d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727f79d6-d116-4786-864f-a5992e2e3acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727f79d6-d116-4786-864f-a5992e2e3acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0f2012-71c5-4e53-8a10-447d06c76332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0f2012-71c5-4e53-8a10-447d06c76332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e704254-0480-4150-baae-cde39ddae764', 'volume_name': 'volume-6e704254-0480-4150-baae-cde39ddae764', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a31713e-7051-4574-b5c4-10621bd7472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a31713e-7051-4574-b5c4-10621bd7472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4afd712-8b45-4f37-9e45-7b54ff41ec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Volume 6e704254-0480-4150-baae-cde39ddae764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e704254-0480-4150-baae-cde39ddae764', 'volume_size': 1} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-512418919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e704254-0480-4150-baae-cde39ddae764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01b44f5faf23447abe108dfab3588c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:25Z,use_quota=True,user_id='244c553e3943450ea550ae493b0112d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Creating volume 6e704254-0480-4150-baae-cde39ddae764 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:25 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:08:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:25 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 1073741824 Sep 25 16:08:25 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:26 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 1073741824" returned: 0 in 0.702s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:26 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 Sep 25 16:08:26 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:26 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764" returned: 0 in 0.314s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4afd712-8b45-4f37-9e45-7b54ff41ec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e704254-0480-4150-baae-cde39ddae764', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5ffe45-5d3b-42f7-9aa2-24c80150b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:26 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Volume volume-6e704254-0480-4150-baae-cde39ddae764 (6e704254-0480-4150-baae-cde39ddae764): created successfully Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5ffe45-5d3b-42f7-9aa2-24c80150b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Flow 'volume_create_manager' (ebebfe72-75d0-462c-ab88-8a10df9fc749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c4506b31-3aed-49fb-96cf-9ddea0456bcf tempest-VolumesTestJSON-2091400933 None] Created volume successfully. Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Flow 'volume_create_manager' (5507c12f-a9c1-4186-adc5-4ab3a67b6e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3a2b7b-46d5-4698-996d-9897fe9e91d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3a2b7b-46d5-4698-996d-9897fe9e91d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1354867739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af18052-cab6-486c-9341-77d3a601d697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f650cec3b0d46279110408676ca76c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:27Z,use_quota=True,user_id='a282ec0ea3744a299a20b5622e134d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04947da5-56b7-493d-a2da-f509bd980fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04947da5-56b7-493d-a2da-f509bd980fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ca77fe-e05c-40b7-a57c-bbb652f8c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ca77fe-e05c-40b7-a57c-bbb652f8c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af18052-cab6-486c-9341-77d3a601d697', 'volume_name': 'volume-3af18052-cab6-486c-9341-77d3a601d697', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0f2a2d-1c81-4b3a-b2ae-278820459207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0f2a2d-1c81-4b3a-b2ae-278820459207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07260e62-e522-445f-b1d6-52593e20a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Volume 3af18052-cab6-486c-9341-77d3a601d697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af18052-cab6-486c-9341-77d3a601d697', 'volume_size': 1} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1354867739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af18052-cab6-486c-9341-77d3a601d697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f650cec3b0d46279110408676ca76c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:27Z,use_quota=True,user_id='a282ec0ea3744a299a20b5622e134d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Creating volume 3af18052-cab6-486c-9341-77d3a601d697 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:27 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:08:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:27 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 1073741824 Sep 25 16:08:27 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:28 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Flow 'volume_create_manager' (ab1a7f2c-ad3d-48d1-9dd7-11e39dcb9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d735d7-9ad9-47eb-95fc-90310be38182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 1073741824" returned: 0 in 0.857s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d735d7-9ad9-47eb-95fc-90310be38182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-380470825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84043a17-23d0-45ad-abad-ee12dd957790,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01b44f5faf23447abe108dfab3588c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:28Z,use_quota=True,user_id='244c553e3943450ea550ae493b0112d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52579590-1c6d-4a00-a7dd-3dfbb750efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52579590-1c6d-4a00-a7dd-3dfbb750efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5535755a-42f2-43ab-acb2-706830e09cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5535755a-42f2-43ab-acb2-706830e09cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84043a17-23d0-45ad-abad-ee12dd957790', 'volume_name': 'volume-84043a17-23d0-45ad-abad-ee12dd957790', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3111aa57-f809-4e9a-9153-14a615d799ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3111aa57-f809-4e9a-9153-14a615d799ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78bd12f-35b5-4211-a58c-0c48d207c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Volume 84043a17-23d0-45ad-abad-ee12dd957790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84043a17-23d0-45ad-abad-ee12dd957790', 'volume_size': 1} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:28 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 Sep 25 16:08:28 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:28 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697" returned: 0 in 0.300s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-380470825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84043a17-23d0-45ad-abad-ee12dd957790,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01b44f5faf23447abe108dfab3588c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:28Z,use_quota=True,user_id='244c553e3943450ea550ae493b0112d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Creating volume 84043a17-23d0-45ad-abad-ee12dd957790 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:28 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07260e62-e522-445f-b1d6-52593e20a110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af18052-cab6-486c-9341-77d3a601d697', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:28 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 1073741824 Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcc0979-6236-4934-b5c8-dfcebe6ca7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:28 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Volume volume-3af18052-cab6-486c-9341-77d3a601d697 (3af18052-cab6-486c-9341-77d3a601d697): created successfully Sep 25 16:08:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcc0979-6236-4934-b5c8-dfcebe6ca7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Flow 'volume_create_manager' (5507c12f-a9c1-4186-adc5-4ab3a67b6e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a19378ba-8f60-4c43-977a-18f0f166956a tempest-ServersNegativeTestJSON-1329185342 None] Created volume successfully. Sep 25 16:08:29 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 1073741824" returned: 0 in 0.564s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:29 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 Sep 25 16:08:29 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:29 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790" returned: 0 in 0.310s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78bd12f-35b5-4211-a58c-0c48d207c650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84043a17-23d0-45ad-abad-ee12dd957790', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82aeff63-c4d7-4fdc-815c-8b3b73cc5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:29 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Volume volume-84043a17-23d0-45ad-abad-ee12dd957790 (84043a17-23d0-45ad-abad-ee12dd957790): created successfully Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82aeff63-c4d7-4fdc-815c-8b3b73cc5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Flow 'volume_create_manager' (ab1a7f2c-ad3d-48d1-9dd7-11e39dcb9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b3d68eca-955c-473a-bfa1-1096536a3dc1 tempest-VolumesTestJSON-2091400933 None] Created volume successfully. Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Flow 'volume_create_manager' (31cf7e07-dafc-4309-865f-ab7a656dcedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a140f75c-9589-4fc1-8543-42c679aafa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a140f75c-9589-4fc1-8543-42c679aafa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1903582309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7b5faa-5c4b-4174-ae0e-3556ecde2a76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01b44f5faf23447abe108dfab3588c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:31Z,use_quota=True,user_id='244c553e3943450ea550ae493b0112d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4049c40b-b949-4307-b121-804a8a4196f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4049c40b-b949-4307-b121-804a8a4196f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de927ee6-1927-4857-b019-98f34701743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de927ee6-1927-4857-b019-98f34701743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7b5faa-5c4b-4174-ae0e-3556ecde2a76', 'volume_name': 'volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6d832a-c991-4482-b7ec-b0a964b872b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6d832a-c991-4482-b7ec-b0a964b872b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203048d5-6977-463e-8655-27dd9daf55ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Volume ea7b5faa-5c4b-4174-ae0e-3556ecde2a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76', 'volume_size': 1} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1903582309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7b5faa-5c4b-4174-ae0e-3556ecde2a76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01b44f5faf23447abe108dfab3588c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:31Z,use_quota=True,user_id='244c553e3943450ea550ae493b0112d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Creating volume ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:31 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:31 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 1073741824 Sep 25 16:08:31 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Flow 'volume_create_manager' (d3c9a38c-d801-4241-b86f-6329e649ce87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e540f10-e970-4f66-848e-f8704e11b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e540f10-e970-4f66-848e-f8704e11b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1111281032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c44e01-da70-4c1b-8647-79d7f51d85c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f650cec3b0d46279110408676ca76c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:32Z,use_quota=True,user_id='a282ec0ea3744a299a20b5622e134d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c4c807-a917-439d-a394-27ad5347c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c4c807-a917-439d-a394-27ad5347c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a239553-09ff-4a3d-aee7-736bd483aeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a239553-09ff-4a3d-aee7-736bd483aeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c44e01-da70-4c1b-8647-79d7f51d85c2', 'volume_name': 'volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c591b09a-1de2-4ab0-8cea-d92faaced77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c591b09a-1de2-4ab0-8cea-d92faaced77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12af1ace-92e3-4677-8830-668161c085c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:31 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Volume c2c44e01-da70-4c1b-8647-79d7f51d85c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2', 'volume_size': 1} Sep 25 16:08:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:32 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 1073741824" returned: 0 in 0.763s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:32 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 Sep 25 16:08:32 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:32 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76" returned: 0 in 0.556s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1111281032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c44e01-da70-4c1b-8647-79d7f51d85c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f650cec3b0d46279110408676ca76c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:32Z,use_quota=True,user_id='a282ec0ea3744a299a20b5622e134d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Creating volume c2c44e01-da70-4c1b-8647-79d7f51d85c2 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:32 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:08:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:32 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 1073741824 Sep 25 16:08:32 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203048d5-6977-463e-8655-27dd9daf55ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e87028b-7066-4d2d-8bec-bb7bb822d85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:33 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Volume volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 (ea7b5faa-5c4b-4174-ae0e-3556ecde2a76): created successfully Sep 25 16:08:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e87028b-7066-4d2d-8bec-bb7bb822d85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Flow 'volume_create_manager' (31cf7e07-dafc-4309-865f-ab7a656dcedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-271ed71a-87a2-47f6-9cbd-cbeab7cfc246 tempest-VolumesTestJSON-2091400933 None] Created volume successfully. Sep 25 16:08:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-66d1a6e4-4d7d-4fda-9db7-a07297942cb7 req-213a2929-5319-425d-9c5c-193388227954 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:33 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 1073741824" returned: 0 in 0.774s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:33 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 Sep 25 16:08:33 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:34 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2" returned: 0 in 0.330s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-66d1a6e4-4d7d-4fda-9db7-a07297942cb7 req-213a2929-5319-425d-9c5c-193388227954 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.485s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-66d1a6e4-4d7d-4fda-9db7-a07297942cb7 req-213a2929-5319-425d-9c5c-193388227954 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12af1ace-92e3-4677-8830-668161c085c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4019a93d-4183-4147-aa97-8075d4416c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:34 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Volume volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 (c2c44e01-da70-4c1b-8647-79d7f51d85c2): created successfully Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4019a93d-4183-4147-aa97-8075d4416c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Flow 'volume_create_manager' (d3c9a38c-d801-4241-b86f-6329e649ce87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-66d1a6e4-4d7d-4fda-9db7-a07297942cb7 req-213a2929-5319-425d-9c5c-193388227954 tempest-ServerActionsTestOtherA-620061493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1720a65-37d8-4aa4-9d90-4940429180b9', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:08:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-24dc901e-d64e-4b7b-b2ea-1296a446a87d tempest-ServersNegativeTestJSON-1329185342 None] Created volume successfully. Sep 25 16:08:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-66d1a6e4-4d7d-4fda-9db7-a07297942cb7 req-213a2929-5319-425d-9c5c-193388227954 tempest-ServerActionsTestOtherA-620061493 None] attachment_update completed successfully. Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "cinder-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "cinder-quobyte-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-quobyte-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f058dd-792c-4fc0-8860-735594c59f28]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:35 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 Sep 25 16:08:35 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:35 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76" returned: 0 in 0.562s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:35 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76 Sep 25 16:08:35 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "cinder-c2c44e01-da70-4c1b-8647-79d7f51d85c2-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-c2c44e01-da70-4c1b-8647-79d7f51d85c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "cinder-quobyte-c2c44e01-da70-4c1b-8647-79d7f51d85c2" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-quobyte-c2c44e01-da70-4c1b-8647-79d7f51d85c2" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d26cea-614e-498b-9c0d-80e1b5e442f3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:35 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76" returned: 0 in 0.387s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-quobyte-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76" released by "delete_volume" :: held 1.017s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:36 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 Sep 25 16:08:36 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Created reservations ['ef7973e8-0183-48e7-82b0-84987ded6207', 'b5521207-01fa-4888-81b5-786453cd5ea0', '17130fb7-58cf-4ce9-9262-b1d54a53c140', '8b956b39-28f3-4c44-a1e7-e6f1179214db'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:36 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:36 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:36 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2" returned: 0 in 0.528s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:36 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2 Sep 25 16:08:36 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:36 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.394s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Deleted volume successfully. Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7038ff26-f6dd-47da-8b66-685799d7a441 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-ea7b5faa-5c4b-4174-ae0e-3556ecde2a76-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:36 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c2c44e01-da70-4c1b-8647-79d7f51d85c2" returned: 0 in 0.350s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-quobyte-c2c44e01-da70-4c1b-8647-79d7f51d85c2" released by "delete_volume" :: held 0.941s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Created reservations ['022834e6-7b5b-4c9f-aa83-8a3816914dd3', '04fba349-8a5e-456c-b826-7b7a5f8d331a', 'f3aed704-ead9-44a7-bf89-635e53d9fdb4', '98aad221-ffd9-4572-aa0b-54ea17bc9d30'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "cinder-3af18052-cab6-486c-9341-77d3a601d697-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:37 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:37 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-3af18052-cab6-486c-9341-77d3a601d697-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "cinder-quobyte-3af18052-cab6-486c-9341-77d3a601d697" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "cinder-84043a17-23d0-45ad-abad-ee12dd957790-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-quobyte-3af18052-cab6-486c-9341-77d3a601d697" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-84043a17-23d0-45ad-abad-ee12dd957790-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279f7ab-6888-47fb-b590-cf4ee0be8450]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "cinder-quobyte-84043a17-23d0-45ad-abad-ee12dd957790" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-quobyte-84043a17-23d0-45ad-abad-ee12dd957790" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f43b0-26d7-461a-9752-eefbfd111f6e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:37 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.480s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Deleted volume successfully. Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-480b40cb-4b88-422f-b742-31334e9d6566 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-c2c44e01-da70-4c1b-8647-79d7f51d85c2-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:37 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 Sep 25 16:08:37 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:37 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 Sep 25 16:08:37 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:37 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697" returned: 0 in 0.605s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:37 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697 Sep 25 16:08:38 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:38 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790" returned: 0 in 0.520s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:38 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790 Sep 25 16:08:38 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:38 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3af18052-cab6-486c-9341-77d3a601d697" returned: 0 in 0.402s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-quobyte-3af18052-cab6-486c-9341-77d3a601d697" released by "delete_volume" :: held 1.165s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Created reservations ['f36d7c2b-dea7-4c0b-9804-7f7b5c340e93', '4649632b-61ec-4697-bd38-9f00719acf26', 'a3a93a82-c69c-4dcf-a0a4-79cc37a5e24d', 'ac704f4a-0a98-47d5-a2cd-bf9268179d7d'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:38 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-84043a17-23d0-45ad-abad-ee12dd957790" returned: 0 in 0.566s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-quobyte-84043a17-23d0-45ad-abad-ee12dd957790" released by "delete_volume" :: held 1.181s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Created reservations ['0461f7a3-f586-4093-88eb-4e32e6e52807', '85d2d053-0dc5-425e-b230-b90c0a72bef4', '739fd83d-bc78-40e3-aa58-b3fa4b10c3d2', 'da98ec4f-4e1a-4cd0-a164-0ed523aada1e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:38 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:38 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:39 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:39 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:39 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.488s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Deleted volume successfully. Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe735e98-e6de-47c2-8ce1-50cc21ad7dd1 tempest-ServersNegativeTestJSON-1329185342 None] Lock "cinder-3af18052-cab6-486c-9341-77d3a601d697-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:39 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.351s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Deleted volume successfully. Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9e312e2e-1909-4a76-b660-76ea26310cb2 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-84043a17-23d0-45ad-abad-ee12dd957790-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "cinder-6e704254-0480-4150-baae-cde39ddae764-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-6e704254-0480-4150-baae-cde39ddae764-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "cinder-quobyte-6e704254-0480-4150-baae-cde39ddae764" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-quobyte-6e704254-0480-4150-baae-cde39ddae764" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820144e-93ab-4c09-b43f-ea2aa84c399e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:40 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 Sep 25 16:08:40 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:40 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-b996890e-5032-489b-8a91-83d837d6f839 req-e2140f85-e0ab-40ac-9cff-ce1c3267b320 tempest-ServerActionsTestOtherA-620061493 None] Terminate volume connection completed successfully. Sep 25 16:08:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-b996890e-5032-489b-8a91-83d837d6f839 req-e2140f85-e0ab-40ac-9cff-ce1c3267b320 tempest-ServerActionsTestOtherA-620061493 None] Deleting attachment f1720a65-37d8-4aa4-9d90-4940429180b9. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:08:40 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764" returned: 0 in 0.789s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:40 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764 Sep 25 16:08:40 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:41 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6e704254-0480-4150-baae-cde39ddae764" returned: 0 in 0.672s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-quobyte-6e704254-0480-4150-baae-cde39ddae764" released by "delete_volume" :: held 1.563s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Created reservations ['0f5f084b-8f31-4ae6-be83-5660bb6ebae6', '46a51ca9-11d3-48d0-aea3-8517db0d9d6d', '4d033794-eaf4-45b3-a6dd-a9730e0e6a00', '922643ba-7182-44df-9c15-d6cc8ad50293'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:41 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:41 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-b996890e-5032-489b-8a91-83d837d6f839 req-43bb8d95-2275-4f3b-b23b-eefaeb33c4a8 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-b996890e-5032-489b-8a91-83d837d6f839 req-43bb8d95-2275-4f3b-b23b-eefaeb33c4a8 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-b996890e-5032-489b-8a91-83d837d6f839 req-43bb8d95-2275-4f3b-b23b-eefaeb33c4a8 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-b996890e-5032-489b-8a91-83d837d6f839 req-43bb8d95-2275-4f3b-b23b-eefaeb33c4a8 tempest-ServerActionsTestOtherA-620061493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b363b63-d393-46a5-8b8d-423174cc3fe3', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:08:42 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.548s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:42 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-b996890e-5032-489b-8a91-83d837d6f839 req-43bb8d95-2275-4f3b-b23b-eefaeb33c4a8 tempest-ServerActionsTestOtherA-620061493 None] attachment_update completed successfully. Sep 25 16:08:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Deleted volume successfully. Sep 25 16:08:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33d30a70-e162-4b07-96d7-fd006daa79f5 tempest-VolumesTestJSON-2091400933 None] Lock "cinder-6e704254-0480-4150-baae-cde39ddae764-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Flow 'volume_create_manager' (822a7852-7931-4a87-8daf-27a7b3dc1725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f4fe55-0fe6-4703-98d4-278e89c47729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f4fe55-0fe6-4703-98d4-278e89c47729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1435145879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e672985-da58-4490-ba57-87461c35a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35740fa96aa34da88c6e386d7dff3e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:44Z,use_quota=True,user_id='035d93fd048a4250808b884a66aaa661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0959ac9-c7ff-4577-9c7c-d6cc2a696c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0959ac9-c7ff-4577-9c7c-d6cc2a696c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4960f3-4f1c-4f79-b1d8-bfe6111c6e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:44 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:08:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4960f3-4f1c-4f79-b1d8-bfe6111c6e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e672985-da58-4490-ba57-87461c35a459', 'volume_name': 'volume-1e672985-da58-4490-ba57-87461c35a459', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc730a34-69a9-43b9-9816-6b52d7e05cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc730a34-69a9-43b9-9816-6b52d7e05cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ea1c5c-ba32-4a15-ad5b-8f202a091a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:45 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Volume 1e672985-da58-4490-ba57-87461c35a459: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e672985-da58-4490-ba57-87461c35a459', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:08:45 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Trying to clone 1e672985-da58-4490-ba57-87461c35a459 from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:08:46 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:08:46 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:08:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e951360-50ab-4785-96d4-755c148b8a3c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:46 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD Sep 25 16:08:46 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:47 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD" returned: 0 in 0.543s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 is fetched for user 035d93fd048a4250808b884a66aaa661. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebe15fb-97d6-4a78-b8ca-2b321f1e63d8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:47 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD Sep 25 16:08:47 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:47 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1435145879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e672985-da58-4490-ba57-87461c35a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35740fa96aa34da88c6e386d7dff3e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:08:44Z,use_quota=True,user_id='035d93fd048a4250808b884a66aaa661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Creating volume 1e672985-da58-4490-ba57-87461c35a459 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:08:47 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:08:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:47 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 1073741824 Sep 25 16:08:47 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:48 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 1073741824" returned: 0 in 0.761s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:48 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 Sep 25 16:08:48 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:49 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459" returned: 0 in 0.559s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:08:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:49 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Attempting download of fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 1e672985-da58-4490-ba57-87461c35a459. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:08:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19e8b91-7006-4c2b-9d9d-8bf1b60009aa]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0ghbapyo {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:49 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0ghbapyo Sep 25 16:08:49 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:50 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0ghbapyo" returned: 0 in 0.954s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0ghbapyo {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:50 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0ghbapyo Sep 25 16:08:50 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:50 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0ghbapyo" returned: 1 in 0.525s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0ghbapyo' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:08:50 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0111c6d7-91a6-4174-9014-d5322e18b4fb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:51 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD Sep 25 16:08:51 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:51 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD" returned: 0 in 0.660s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:51 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1010}} Sep 25 16:08:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 iflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:51 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 iflag=direct Sep 25 16:08:51 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:52 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 iflag=direct" returned: 0 in 0.486s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:52 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 oflag=direct Sep 25 16:08:52 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:52 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 oflag=direct" returned: 0 in 0.458s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:52 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:08:52 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:53 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 1.057s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:53 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_4w_y6ab4devstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459, size 21.00 MB, duration 1.06 sec {{(pid=87467) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:08:53 devstack cinder-volume[87467]: INFO cinder.volume.volume_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Volume copy 21.00 MB at 19.84 MB/s Sep 25 16:08:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:53 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 1G Sep 25 16:08:53 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:54 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 1G" returned: 0 in 0.534s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Downloaded image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 1e672985-da58-4490-ba57-87461c35a459 successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 for user 035d93fd048a4250808b884a66aaa661 is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Marking volume 1e672985-da58-4490-ba57-87461c35a459 as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Copying metadata from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 to 1e672985-da58-4490-ba57-87461c35a459. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Creating volume glance metadata for volume 1e672985-da58-4490-ba57-87461c35a459 backed by image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ea1c5c-ba32-4a15-ad5b-8f202a091a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e672985-da58-4490-ba57-87461c35a459', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d221880-b16e-493e-acb6-4ded517de646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:08:54 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Volume volume-1e672985-da58-4490-ba57-87461c35a459 (1e672985-da58-4490-ba57-87461c35a459): created successfully Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d221880-b16e-493e-acb6-4ded517de646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:08:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Flow 'volume_create_manager' (822a7852-7931-4a87-8daf-27a7b3dc1725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:08:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ac71e1b5-ef4f-4d87-98a4-ff5345ff4466 tempest-VolumesImageMetadata-1740790085 None] Created volume successfully. Sep 25 16:08:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Acquiring lock "cinder-1e672985-da58-4490-ba57-87461c35a459-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Lock "cinder-1e672985-da58-4490-ba57-87461c35a459-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Acquiring lock "cinder-quobyte-1e672985-da58-4490-ba57-87461c35a459" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:08:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Lock "cinder-quobyte-1e672985-da58-4490-ba57-87461c35a459" acquired by "delete_volume" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:08:56 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc98db-2892-40b9-ab91-808c01ac5545]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:08:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:56 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 Sep 25 16:08:56 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:56 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459" returned: 0 in 0.649s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:56 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459 Sep 25 16:08:56 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:57 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1e672985-da58-4490-ba57-87461c35a459" returned: 0 in 0.536s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Lock "cinder-quobyte-1e672985-da58-4490-ba57-87461c35a459" released by "delete_volume" :: held 1.268s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Created reservations ['d20f297a-66cd-4d0a-8bbc-b1877c90fc63', 'bb15215e-8c7b-4ebb-980c-9a0db9480061', '8fdaea20-7850-40e8-9f0c-7c7fa400297f', '82ff6461-2bf3-4867-aed6-62188455f87a'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:08:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:08:57 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:08:57 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:08:58 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Sep 25 16:08:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.496s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:08:58 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:08:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Deleted volume successfully. Sep 25 16:08:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f280ca2c-934e-4eb6-a34a-91603d384482 tempest-VolumesImageMetadata-1740790085 None] Lock "cinder-1e672985-da58-4490-ba57-87461c35a459-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Flow 'volume_create_manager' (25573242-031f-48c5-b9ce-fc82f09e93a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07939025-816a-4776-b05e-a8dfc4a8ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07939025-816a-4776-b05e-a8dfc4a8ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1363634437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92295f8d-c529-4a3f-928a-9ed4e9894cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39211c6f425747c8a79e7493621710aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:05Z,use_quota=True,user_id='a2ea71633e964e2489e6f64f7947e4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919cd75b-0231-40c0-8fcd-3e47d70148b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919cd75b-0231-40c0-8fcd-3e47d70148b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca55d8f3-1d18-40fa-81c1-1396e1635e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca55d8f3-1d18-40fa-81c1-1396e1635e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92295f8d-c529-4a3f-928a-9ed4e9894cdc', 'volume_name': 'volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83636dc6-f9cc-4f66-bfed-f09fb6f7a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83636dc6-f9cc-4f66-bfed-f09fb6f7a881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beedf5b6-56f3-4563-a95a-af0a41a5dad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:05 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Volume 92295f8d-c529-4a3f-928a-9ed4e9894cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc', 'volume_size': 1} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1363634437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92295f8d-c529-4a3f-928a-9ed4e9894cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39211c6f425747c8a79e7493621710aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:05Z,use_quota=True,user_id='a2ea71633e964e2489e6f64f7947e4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Creating volume 92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:05 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:05 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc 1073741824 Sep 25 16:09:05 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:05 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc 1073741824" returned: 0 in 0.621s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:06 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc Sep 25 16:09:06 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:06 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc" returned: 0 in 0.373s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beedf5b6-56f3-4563-a95a-af0a41a5dad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9393ba04-a64a-40d6-b227-3de2591c4bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:06 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Volume volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc (92295f8d-c529-4a3f-928a-9ed4e9894cdc): created successfully Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9393ba04-a64a-40d6-b227-3de2591c4bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Flow 'volume_create_manager' (25573242-031f-48c5-b9ce-fc82f09e93a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b612e2fb-0c14-4936-8695-1548e4c7436c tempest-SnapshotMetadataTestJSON-845968958 None] Created volume successfully. Sep 25 16:09:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Creating offline snapshot c01b0866-452b-441c-abd6-b461967b51f7 of volume 92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:09:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b605d02-ff39-4be7-8979-77db975d0084]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:07 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc Sep 25 16:09:07 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:08 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc" returned: 0 in 0.500s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:08 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 1G Sep 25 16:09:08 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:08 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 1G" returned: 0 in 0.643s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:08 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 Sep 25 16:09:08 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:09 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7" returned: 0 in 0.332s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:09 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 is being set with open permissions: ugo+rw Sep 25 16:09:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:09 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 Sep 25 16:09:09 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:09 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7" returned: 0 in 0.334s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:09 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.info Sep 25 16:09:09 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:09 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.info" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:09 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.info is being set with open permissions: ugo+rw Sep 25 16:09:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:10 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.info Sep 25 16:09:10 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:10 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.info" returned: 0 in 0.520s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.943s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:10 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2fcd5546-f58e-4f36-94fd-30fe78c2214b tempest-SnapshotMetadataTestJSON-845968958 None] Create snapshot completed successfully Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "cinder-c01b0866-452b-441c-abd6-b461967b51f7-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-c01b0866-452b-441c-abd6-b461967b51f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "cinder-quobyte-92295f8d-c529-4a3f-928a-9ed4e9894cdc" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-quobyte-92295f8d-c529-4a3f-928a-9ed4e9894cdc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "cinder-quobyte-c01b0866-452b-441c-abd6-b461967b51f7" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-quobyte-c01b0866-452b-441c-abd6-b461967b51f7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Deleting offline snapshot c01b0866-452b-441c-abd6-b461967b51f7 of volume 92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] snapshot_file for this snap is: volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[758cc0ef-c2bc-41d8-ae6a-3c008f6dce98]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:12 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 Sep 25 16:09:12 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:13 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7" returned: 0 in 0.508s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:09:13 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0275b226-d10c-4b69-9388-f08e1390cd74]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:13 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc Sep 25 16:09:13 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:13 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e7f17104-601f-41e3-9077-d6acae372941 tempest-GroupsV314Test-1530894437 None] Group tempest-GroupsV314Test-Group-963384986: creating Sep 25 16:09:13 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e7f17104-601f-41e3-9077-d6acae372941 tempest-GroupsV314Test-1530894437 None] Group tempest-GroupsV314Test-Group-963384986: created successfully Sep 25 16:09:13 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e7f17104-601f-41e3-9077-d6acae372941 tempest-GroupsV314Test-1530894437 None] Create group completed successfully. Sep 25 16:09:13 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc" returned: 0 in 0.532s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:13 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 Sep 25 16:09:13 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:14 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7" returned: 0 in 0.476s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:14 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7 Sep 25 16:09:14 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:14 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc.c01b0866-452b-441c-abd6-b461967b51f7" returned: 0 in 0.354s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-quobyte-c01b0866-452b-441c-abd6-b461967b51f7" released by "_delete_snapshot" :: held 2.102s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-quobyte-92295f8d-c529-4a3f-928a-9ed4e9894cdc" released by "delete_snapshot" :: held 2.143s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:14 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Created reservations ['6b4e0a23-a279-42d6-a3d4-44e1ec069da1', '6392edaa-700f-4b62-aa1a-9561eddaf750', '0106a3d0-70e7-49f6-9910-5760754119a6', '695330a3-665d-4c45-9415-66fec34154d3'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:14 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Delete snapshot completed successfully. Sep 25 16:09:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-63e7d8e1-745e-4133-bd17-62d66839de6e tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-c01b0866-452b-441c-abd6-b461967b51f7-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Flow 'volume_create_manager' (b6e4f3c0-2724-425e-8d38-b1a4d5a6892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa04f73-e1d3-4379-a0ef-ff3c4652e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa04f73-e1d3-4379-a0ef-ff3c4652e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-782843269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ebb82ac-c5bf-4499-b9d7-d4bd9d60aebc,host='devstack@QuobyteHD#QuobyteHD',id=3e00a8cf-6275-4a4f-a75b-981c7333ff52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06ccc8518cd46d494b286a9e33f6ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:15Z,use_quota=True,user_id='8451be2277044da9a88430dbe701f3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ed2cbe5-4d74-4617-b2b1-0a499b81cecd),volume_type_id=9ed2cbe5-4d74-4617-b2b1-0a499b81cecd)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4a2071-4806-4c32-a3af-2ed24ac63efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4a2071-4806-4c32-a3af-2ed24ac63efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d224f71c-877b-44b9-9306-738a42b16757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d224f71c-877b-44b9-9306-738a42b16757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e00a8cf-6275-4a4f-a75b-981c7333ff52', 'volume_name': 'volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c942f4-9042-44cc-8893-8b50fa24d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c942f4-9042-44cc-8893-8b50fa24d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668d2fd4-e733-4c2b-abd5-b252fa56e319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:15 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Volume 3e00a8cf-6275-4a4f-a75b-981c7333ff52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52', 'volume_size': 1} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5ebb82ac-c5bf-4499-b9d7-d4bd9d60aebc,created_at=2026-09-25T14:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-782843269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ebb82ac-c5bf-4499-b9d7-d4bd9d60aebc,host='devstack@QuobyteHD#QuobyteHD',id=3e00a8cf-6275-4a4f-a75b-981c7333ff52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06ccc8518cd46d494b286a9e33f6ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:15Z,use_quota=True,user_id='8451be2277044da9a88430dbe701f3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ed2cbe5-4d74-4617-b2b1-0a499b81cecd),volume_type_id=9ed2cbe5-4d74-4617-b2b1-0a499b81cecd)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Creating volume 3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:15 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:15 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 1073741824 Sep 25 16:09:15 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:15 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:09:15 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:15 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.349s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "cinder-92295f8d-c529-4a3f-928a-9ed4e9894cdc-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-92295f8d-c529-4a3f-928a-9ed4e9894cdc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "cinder-quobyte-92295f8d-c529-4a3f-928a-9ed4e9894cdc" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-quobyte-92295f8d-c529-4a3f-928a-9ed4e9894cdc" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb88ae42-59cd-4d25-b28e-0edf013761fa]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:16 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc Sep 25 16:09:16 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:16 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 1073741824" returned: 0 in 0.811s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=83,cinder:UPDATE=82,cinder:DELETE=9,cinder:INSERT=21 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:16 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 Sep 25 16:09:16 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:16 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc" returned: 0 in 0.587s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:16 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc Sep 25 16:09:16 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:16 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52" returned: 0 in 0.473s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668d2fd4-e733-4c2b-abd5-b252fa56e319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060e0283-755d-4389-bfb2-47fb831d8a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:16 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Volume volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 (3e00a8cf-6275-4a4f-a75b-981c7333ff52): created successfully Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060e0283-755d-4389-bfb2-47fb831d8a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Flow 'volume_create_manager' (b6e4f3c0-2724-425e-8d38-b1a4d5a6892b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3484e685-4c6e-4026-bed9-eef7151d81c6 tempest-GroupsV314Test-1530894437 None] Created volume successfully. Sep 25 16:09:16 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-92295f8d-c529-4a3f-928a-9ed4e9894cdc" returned: 0 in 0.391s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:16 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-quobyte-92295f8d-c529-4a3f-928a-9ed4e9894cdc" released by "delete_volume" :: held 1.077s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Created reservations ['fff17ea1-60c2-45ae-963e-c8b24ebe0f0a', '6cd78923-9f19-4cab-8434-f3456a130fb8', 'ef0c0097-92f6-4928-9874-273a54a3fa9f', '6923d047-e7ef-4d03-8bf7-e7bf4a60537c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:17 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:09:17 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:17 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.307s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Deleted volume successfully. Sep 25 16:09:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef009011-9cbf-4c60-a2a4-a3f69121d118 tempest-SnapshotMetadataTestJSON-845968958 None] Lock "cinder-92295f8d-c529-4a3f-928a-9ed4e9894cdc-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:18 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Cloning volume 3e00a8cf-6275-4a4f-a75b-981c7333ff52 to volume 19bc4b21-7958-4d31-a4b7-a853744a7cb3 Sep 25 16:09:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Creating offline snapshot a1b56ffe-639f-4efa-be21-022e07f8a352 of volume 3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:09:18 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5778a8-47c2-4e6f-904a-e72030a62bed]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:18 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 Sep 25 16:09:18 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:19 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52" returned: 0 in 0.587s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:19 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 1G Sep 25 16:09:19 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:19 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 1G" returned: 0 in 0.619s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:20 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 Sep 25 16:09:20 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:20 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352" returned: 0 in 0.484s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:20 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:09:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:20 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 Sep 25 16:09:20 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:20 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:20 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.info Sep 25 16:09:20 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:21 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.info" returned: 0 in 0.348s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:21 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:21 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.info Sep 25 16:09:21 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:21 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.info" returned: 0 in 0.308s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Acquiring lock "cinder-quobyte-19bc4b21-7958-4d31-a4b7-a853744a7cb3" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-19bc4b21-7958-4d31-a4b7-a853744a7cb3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] snapshot: a1b56ffe-639f-4efa-be21-022e07f8a352, volume: 19bc4b21-7958-4d31-a4b7-a853744a7cb3, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[feabab02-3a09-46d3-bd35-ce0c51ce36a5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:21 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 Sep 25 16:09:21 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:22 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352" returned: 0 in 0.512s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7377ddb9-007e-44f5-aff1-e34877372bbf]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:22 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 Sep 25 16:09:22 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:22 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52" returned: 0 in 0.501s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:09:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:22 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 Sep 25 16:09:22 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Flow 'volume_create_manager' (55793835-516f-441d-be33-982e9580b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d2bd9e-17ea-48f0-a3a8-4bfb9505757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d2bd9e-17ea-48f0-a3a8-4bfb9505757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1823947686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a94d35d-6ae4-4b5e-9766-f59219c08a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71545dd1a57b4869a1fe6e6f5c35cf83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:24Z,use_quota=True,user_id='7d1666744bec4dfe8516769bda5c4a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bafbf1-3a1c-4e47-b23d-4ab7be7db50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bafbf1-3a1c-4e47-b23d-4ab7be7db50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03a2734-e7df-4b36-966a-c7cbd450640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:24 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:09:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03a2734-e7df-4b36-966a-c7cbd450640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a94d35d-6ae4-4b5e-9766-f59219c08a4b', 'volume_name': 'volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef63756-dfa2-4c63-9f78-b2f71a890449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef63756-dfa2-4c63-9f78-b2f71a890449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb0a5a2-6cc9-4bca-96b9-b5a2a4189839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Volume 8a94d35d-6ae4-4b5e-9766-f59219c08a4b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:09:25 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Trying to clone 8a94d35d-6ae4-4b5e-9766-f59219c08a4b from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:09:26 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:09:26 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:09:26 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[73557ce6-878c-4466-b37f-ec7ea35116e8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:26 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD Sep 25 16:09:26 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:27 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD" returned: 0 in 1.048s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:27 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 is fetched for user 7d1666744bec4dfe8516769bda5c4a13. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:09:27 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=97,cinder:SELECT=86,cinder:INSERT=33,cinder:DELETE=5 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:09:27 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c4acc0-cd97-4d66-a85d-f49e94fbd4ee]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:27 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD Sep 25 16:09:27 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:28 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD" returned: 0 in 0.977s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-2711442e-1df4-436c-920c-f87d8c2e5cda req-17ae70f5-5ecd-4679-90b4-b8c0c9b5cef4 tempest-ServerActionsTestOtherA-620061493 None] Terminate volume connection completed successfully. Sep 25 16:09:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-2711442e-1df4-436c-920c-f87d8c2e5cda req-17ae70f5-5ecd-4679-90b4-b8c0c9b5cef4 tempest-ServerActionsTestOtherA-620061493 None] Deleting attachment 2b363b63-d393-46a5-8b8d-423174cc3fe3. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3" returned: 0 in 10.432s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52, size 1024.00 MB, duration 10.43 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:09:33 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Converted 1024.00 MB image at 98.15 MB/s Sep 25 16:09:33 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:33 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 Sep 25 16:09:33 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:33 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3" returned: 0 in 0.692s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-19bc4b21-7958-4d31-a4b7-a853744a7cb3" released by "_copy_volume_from_snapshot" :: held 12.293s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Acquiring lock "cinder-quobyte-a1b56ffe-639f-4efa-be21-022e07f8a352" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-a1b56ffe-639f-4efa-be21-022e07f8a352" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Deleting offline snapshot a1b56ffe-639f-4efa-be21-022e07f8a352 of volume 3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:09:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] snapshot_file for this snap is: volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:09:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24678ed-eda4-485d-82fe-90407e3350ab]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:34 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 Sep 25 16:09:34 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:35 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352" returned: 0 in 1.204s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:09:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfd8918-8c84-45ab-834f-a26b16674fdf]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:35 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 Sep 25 16:09:35 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:36 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52" returned: 0 in 1.134s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:36 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 Sep 25 16:09:36 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:37 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352" returned: 0 in 0.566s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:37 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352 Sep 25 16:09:37 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:37 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52.a1b56ffe-639f-4efa-be21-022e07f8a352" returned: 0 in 0.540s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-a1b56ffe-639f-4efa-be21-022e07f8a352" released by "_delete_snapshot" :: held 3.712s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.028s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.189s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1823947686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a94d35d-6ae4-4b5e-9766-f59219c08a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71545dd1a57b4869a1fe6e6f5c35cf83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:24Z,use_quota=True,user_id='7d1666744bec4dfe8516769bda5c4a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Creating volume 8a94d35d-6ae4-4b5e-9766-f59219c08a4b {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:37 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:09:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:37 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 1073741824 Sep 25 16:09:37 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fc4fbcdd-3373-4b83-a6bb-5075a9493243 tempest-GroupsV314Test-1530894437 None] Create group from source-group-5ebb82ac-c5bf-4499-b9d7-d4bd9d60aebc completed successfully. Sep 25 16:09:38 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 1073741824" returned: 0 in 0.699s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:38 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b Sep 25 16:09:38 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:38 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b" returned: 0 in 0.330s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:38 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Attempting download of fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 8a94d35d-6ae4-4b5e-9766-f59219c08a4b. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e850bf51-b171-485f-88ec-2ae4b69da2a1]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvpyxw01 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:39 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvpyxw01 Sep 25 16:09:39 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:39 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvpyxw01" returned: 0 in 0.603s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvpyxw01 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Acquiring lock "cinder-quobyte-19bc4b21-7958-4d31-a4b7-a853744a7cb3" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-19bc4b21-7958-4d31-a4b7-a853744a7cb3" acquired by "delete_volume" :: waited 0.059s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:39 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvpyxw01 Sep 25 16:09:39 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f30ee-042d-4466-9ae8-a48f2179f0c4]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:40 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 Sep 25 16:09:40 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:40 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvpyxw01" returned: 1 in 0.818s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvpyxw01' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:09:40 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4d3a61-5ee6-413d-9c0b-3a438e7ca82f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:40 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD Sep 25 16:09:40 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:40 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3" returned: 0 in 0.868s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:40 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3 Sep 25 16:09:40 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:41 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19bc4b21-7958-4d31-a4b7-a853744a7cb3" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:41 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-19bc4b21-7958-4d31-a4b7-a853744a7cb3" released by "delete_volume" :: held 1.447s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1010}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b iflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:41 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b iflag=direct Sep 25 16:09:41 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Created reservations ['0f1faf9c-95c3-48eb-8761-aab1b4d582a2'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:41 devstack cinder-volume[87467]: WARNING cinder.quota [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-368298093 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-368298093, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:09:41 devstack cinder-volume[87467]: WARNING cinder.quota [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-368298093 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-368298093, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Created reservations ['813a6b92-09dc-431a-99be-c88dc66197c2', '7103088e-3d27-43d6-9c88-b8273bd44f38', '12d45772-8863-4b0f-9281-8fbdf1439739', '2d058095-1bb4-4e9a-aab1-445aa027a933'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:41 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b iflag=direct" returned: 0 in 0.443s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:41 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b oflag=direct Sep 25 16:09:41 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:41 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:09:41 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:42 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b oflag=direct" returned: 0 in 0.550s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:42 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:09:42 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:42 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.635s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-350314bd-4734-4329-8e86-288a403c16e5 tempest-GroupsV314Test-1530894437 None] Delete group completed successfully. Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Flow 'volume_create_manager' (c7b6738c-ac00-4a7c-a8ed-4f6526994d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825864ca-e940-4f94-af65-43c5a7507c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825864ca-e940-4f94-af65-43c5a7507c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1231944416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eaca1ee-1575-4b04-a46b-e51e6db307c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e9cdc4074d0480ddadc53279e67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:42Z,use_quota=True,user_id='51556457a738436ebd210e3e7c6d69ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4686604e-1251-4ced-be82-a8ae58a356dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4686604e-1251-4ced-be82-a8ae58a356dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412365ed-0324-4f1c-8b10-d010a73a015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:42 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412365ed-0324-4f1c-8b10-d010a73a015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4eaca1ee-1575-4b04-a46b-e51e6db307c2', 'volume_name': 'volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc915c62-8e9c-41ca-87ae-7614e3b219fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc915c62-8e9c-41ca-87ae-7614e3b219fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdaa1c9-2b27-4e40-acad-4ef7bde6515e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Volume 4eaca1ee-1575-4b04-a46b-e51e6db307c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Trying to clone 4eaca1ee-1575-4b04-a46b-e51e6db307c2 from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Acquiring lock "cinder-quobyte-3e00a8cf-6275-4a4f-a75b-981c7333ff52" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-3e00a8cf-6275-4a4f-a75b-981c7333ff52" acquired by "delete_volume" :: waited 0.060s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa282119-bc76-42c8-8774-afc7fc1d0b0f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:43 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 1.348s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_5krlszbmdevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b, size 21.00 MB, duration 1.35 sec {{(pid=87467) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:09:43 devstack cinder-volume[87467]: INFO cinder.volume.volume_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Volume copy 21.00 MB at 15.55 MB/s Sep 25 16:09:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:43 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 1G Sep 25 16:09:43 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 Sep 25 16:09:43 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:43 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:09:44 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b1dd5-1ade-4d77-a0a3-dc8018f1b043]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:44 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 1G" returned: 0 in 0.597s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Downloaded image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 8a94d35d-6ae4-4b5e-9766-f59219c08a4b successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 for user 7d1666744bec4dfe8516769bda5c4a13 is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Marking volume 8a94d35d-6ae4-4b5e-9766-f59219c08a4b as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Copying metadata from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 to 8a94d35d-6ae4-4b5e-9766-f59219c08a4b. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Creating volume glance metadata for volume 8a94d35d-6ae4-4b5e-9766-f59219c08a4b backed by image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:09:44 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52" returned: 0 in 0.772s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:44 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD Sep 25 16:09:44 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:44 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52 Sep 25 16:09:44 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb0a5a2-6cc9-4bca-96b9-b5a2a4189839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e857c1c9-3b0e-4855-bb15-a8924cf60afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:44 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Volume volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b (8a94d35d-6ae4-4b5e-9766-f59219c08a4b): created successfully Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e857c1c9-3b0e-4855-bb15-a8924cf60afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Flow 'volume_create_manager' (55793835-516f-441d-be33-982e9580b629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6dc110fd-4e97-4ece-a511-5d277c6ce9cc tempest-VolumesExtendTest-1801925586 None] Created volume successfully. Sep 25 16:09:44 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD" returned: 0 in 0.608s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 is fetched for user 51556457a738436ebd210e3e7c6d69ff. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3277f13d-958e-4e1d-a3d4-47fa4a6b53a9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:45 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3e00a8cf-6275-4a4f-a75b-981c7333ff52" returned: 0 in 0.701s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Lock "cinder-quobyte-3e00a8cf-6275-4a4f-a75b-981c7333ff52" released by "delete_volume" :: held 1.679s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:45 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD Sep 25 16:09:45 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Created reservations ['c4214ed0-c7d9-42dd-bf9d-3942efa30ce6'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Created reservations ['b7583349-f16a-48a9-b7b6-1f61fca4da3a', 'e6b81ff0-ece7-4c79-a04a-d3931d0d83bc', '7ed89f36-6ac0-4012-91cd-2c0bf866e3d8', '70bb96e4-9b6a-4737-8637-e1fd023036c6'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:45 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1231944416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eaca1ee-1575-4b04-a46b-e51e6db307c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e9cdc4074d0480ddadc53279e67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:42Z,use_quota=True,user_id='51556457a738436ebd210e3e7c6d69ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Creating volume 4eaca1ee-1575-4b04-a46b-e51e6db307c2 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:45 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:09:45 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:45 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:45 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 1073741824 Sep 25 16:09:45 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:45 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.448s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:45 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:45 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5ac310d3-c8a0-4a1e-b84a-ea698f448591 tempest-GroupsV314Test-1530894437 None] Delete group completed successfully. Sep 25 16:09:46 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 1073741824" returned: 0 in 0.748s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:46 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 Sep 25 16:09:46 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:46 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2" returned: 0 in 0.308s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.849s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703aa43-c28c-4b4f-bf0f-31c81114ad8d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Attempting download of fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 4eaca1ee-1575-4b04-a46b-e51e6db307c2. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3bdea3-5f34-4589-a639-e3f305eee23d]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_r9c9hmuy {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:46 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b Sep 25 16:09:46 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:46 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_r9c9hmuy Sep 25 16:09:46 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:47 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b" returned: 0 in 0.637s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 2G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:47 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_r9c9hmuy" returned: 0 in 0.527s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_r9c9hmuy {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b 2G" returned: 0 in 0.138s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.808s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:47 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_r9c9hmuy Sep 25 16:09:47 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ab6462f4-8141-4dd1-8e1a-c2955129da00 tempest-VolumesExtendTest-1801925586 None] Extend volume completed successfully. Sep 25 16:09:47 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_r9c9hmuy" returned: 1 in 0.429s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_r9c9hmuy' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf090fdc-cbb7-4f32-a5b8-eea9de74a9c7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:47 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD Sep 25 16:09:47 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:48 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1010}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 iflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:48 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 iflag=direct Sep 25 16:09:48 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:48 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 iflag=direct" returned: 0 in 0.446s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:48 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 oflag=direct Sep 25 16:09:48 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Acquiring lock "cinder-8a94d35d-6ae4-4b5e-9766-f59219c08a4b-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Lock "cinder-8a94d35d-6ae4-4b5e-9766-f59219c08a4b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Acquiring lock "cinder-quobyte-8a94d35d-6ae4-4b5e-9766-f59219c08a4b" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-8a94d35d-6ae4-4b5e-9766-f59219c08a4b" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff7d499-ede3-4d3c-9ca0-3438b3a8b027]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:49 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 oflag=direct" returned: 0 in 0.421s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:49 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b Sep 25 16:09:49 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:49 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:09:49 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:49 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b" returned: 0 in 0.610s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:49 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b Sep 25 16:09:49 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:49 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8a94d35d-6ae4-4b5e-9766-f59219c08a4b" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-8a94d35d-6ae4-4b5e-9766-f59219c08a4b" released by "delete_volume" :: held 1.097s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:49 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 0.954s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_2d852rzjdevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2, size 21.00 MB, duration 1.00 sec {{(pid=87467) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:09:49 devstack cinder-volume[87467]: INFO cinder.volume.volume_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Volume copy 21.00 MB at 21.00 MB/s Sep 25 16:09:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:50 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 1G Sep 25 16:09:50 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Created reservations ['e17f70d0-72c5-4b0f-bc38-4ff8ec584225', 'a95bb6f1-319f-4f08-b736-568d55edca30', 'f5457a6a-aaf9-4f6d-81e5-97d4cf099141', '65127c80-02ab-469e-b9ac-8ab1eead9bc8'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:50 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:09:50 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:50 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 1G" returned: 0 in 0.628s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Downloaded image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 4eaca1ee-1575-4b04-a46b-e51e6db307c2 successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 for user 51556457a738436ebd210e3e7c6d69ff is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Marking volume 4eaca1ee-1575-4b04-a46b-e51e6db307c2 as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Copying metadata from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 to 4eaca1ee-1575-4b04-a46b-e51e6db307c2. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Creating volume glance metadata for volume 4eaca1ee-1575-4b04-a46b-e51e6db307c2 backed by image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:09:50 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.499s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:09:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Deleted volume successfully. Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ca4f9e80-5062-4457-977c-023cf57f6b9b tempest-VolumesExtendTest-1801925586 None] Lock "cinder-8a94d35d-6ae4-4b5e-9766-f59219c08a4b-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdaa1c9-2b27-4e40-acad-4ef7bde6515e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01180a55-ec82-450f-bdb7-c771dd202b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Volume volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 (4eaca1ee-1575-4b04-a46b-e51e6db307c2): created successfully Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01180a55-ec82-450f-bdb7-c771dd202b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Flow 'volume_create_manager' (c7b6738c-ac00-4a7c-a8ed-4f6526994d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-411ddced-dc76-48f5-9fa4-4c04e59f52ba tempest-ServerActionsTestOtherA-620061493 None] Created volume successfully. Sep 25 16:09:51 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:09:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Flow 'volume_create_manager' (4fc8bc97-5e7d-4e7c-9b08-10e09db531a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f0eb9e-eaa9-4c6e-ad7b-2f6c90bc68af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f0eb9e-eaa9-4c6e-ad7b-2f6c90bc68af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1043646618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f159e4e-6999-4339-b08f-d9e184e182e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71545dd1a57b4869a1fe6e6f5c35cf83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:52Z,use_quota=True,user_id='7d1666744bec4dfe8516769bda5c4a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee61b007-0215-4ede-bede-e092daa84105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee61b007-0215-4ede-bede-e092daa84105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c783468-a5cc-430e-b473-abbfe91c4ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c783468-a5cc-430e-b473-abbfe91c4ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f159e4e-6999-4339-b08f-d9e184e182e5', 'volume_name': 'volume-1f159e4e-6999-4339-b08f-d9e184e182e5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc77334-1e0d-4f38-9c31-66fe71315201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc77334-1e0d-4f38-9c31-66fe71315201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380f8d2e-5d35-464c-8f77-9e9af72ddbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Volume 1f159e4e-6999-4339-b08f-d9e184e182e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f159e4e-6999-4339-b08f-d9e184e182e5', 'volume_size': 1} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1043646618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f159e4e-6999-4339-b08f-d9e184e182e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71545dd1a57b4869a1fe6e6f5c35cf83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:09:52Z,use_quota=True,user_id='7d1666744bec4dfe8516769bda5c4a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Creating volume 1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:09:52 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:52 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 1073741824 Sep 25 16:09:52 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:52 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 1073741824" returned: 0 in 0.730s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:52 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 Sep 25 16:09:52 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:53 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5" returned: 0 in 0.352s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:09:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380f8d2e-5d35-464c-8f77-9e9af72ddbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f159e4e-6999-4339-b08f-d9e184e182e5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4dce1a-6b75-4b76-a57a-e83f9dbfb456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:09:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Volume volume-1f159e4e-6999-4339-b08f-d9e184e182e5 (1f159e4e-6999-4339-b08f-d9e184e182e5): created successfully Sep 25 16:09:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4dce1a-6b75-4b76-a57a-e83f9dbfb456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:09:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Flow 'volume_create_manager' (4fc8bc97-5e7d-4e7c-9b08-10e09db531a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:09:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f028d5b5-2b95-483a-8220-6139654548fc tempest-VolumesExtendTest-1801925586 None] Created volume successfully. Sep 25 16:09:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Creating offline snapshot 5ddb698a-2559-47a5-9dbf-16a1db8a444b of volume 1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:09:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb046757-f1c3-44e9-ab27-b46f91772680]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:54 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 Sep 25 16:09:54 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:54 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5" returned: 0 in 0.572s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:54 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b 1G Sep 25 16:09:54 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-aeb4a413-47bc-4495-91cc-e80e387aa3c2 req-94399639-d165-449c-bdf2-863804125825 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:55 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b 1G" returned: 0 in 0.662s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f159e4e-6999-4339-b08f-d9e184e182e5 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:55 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f159e4e-6999-4339-b08f-d9e184e182e5 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b Sep 25 16:09:55 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:55 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f159e4e-6999-4339-b08f-d9e184e182e5 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b" returned: 0 in 0.396s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:55 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b is being set with open permissions: ugo+rw Sep 25 16:09:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:55 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b Sep 25 16:09:55 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:56 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b" returned: 0 in 0.424s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:56 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.info Sep 25 16:09:56 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:56 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.info" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:56 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.info is being set with open permissions: ugo+rw Sep 25 16:09:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:56 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.info Sep 25 16:09:56 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:57 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.info" returned: 0 in 0.370s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-aeb4a413-47bc-4495-91cc-e80e387aa3c2 req-94399639-d165-449c-bdf2-863804125825 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.616s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-aeb4a413-47bc-4495-91cc-e80e387aa3c2 req-94399639-d165-449c-bdf2-863804125825 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c980e101-0824-4b91-9b47-771fc7f07b57 tempest-VolumesExtendTest-1801925586 None] Create snapshot completed successfully Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-aeb4a413-47bc-4495-91cc-e80e387aa3c2 req-94399639-d165-449c-bdf2-863804125825 tempest-ServerActionsTestOtherA-620061493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b65ee54c-3900-405f-ad49-cbaef06470d7', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:09:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-aeb4a413-47bc-4495-91cc-e80e387aa3c2 req-94399639-d165-449c-bdf2-863804125825 tempest-ServerActionsTestOtherA-620061493 None] attachment_update completed successfully. Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feaa4b7-2532-4501-95c9-1b11cda8e49e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:57 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 Sep 25 16:09:57 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:09:58 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Sep 25 16:09:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5" returned: 0 in 0.603s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b 2G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b 2G" returned: 0 in 0.222s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:09:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.914s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:09:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-60d25bae-e471-4420-9302-0008705129a2 tempest-VolumesExtendTest-1801925586 None] Extend volume completed successfully. Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "cinder-5ddb698a-2559-47a5-9dbf-16a1db8a444b-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-5ddb698a-2559-47a5-9dbf-16a1db8a444b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "cinder-quobyte-1f159e4e-6999-4339-b08f-d9e184e182e5" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-1f159e4e-6999-4339-b08f-d9e184e182e5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "cinder-quobyte-5ddb698a-2559-47a5-9dbf-16a1db8a444b" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-5ddb698a-2559-47a5-9dbf-16a1db8a444b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Deleting offline snapshot 5ddb698a-2559-47a5-9dbf-16a1db8a444b of volume 1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] snapshot_file for this snap is: volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c664c-c797-46e8-b016-51afba08bc70]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:09:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:09:59 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b Sep 25 16:09:59 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:00 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b" returned: 0 in 0.752s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f159e4e-6999-4339-b08f-d9e184e182e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0404e384-b7a1-4bc0-975e-60546cab4657]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:00 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 Sep 25 16:10:00 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:01 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5" returned: 0 in 0.835s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:01 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b Sep 25 16:10:01 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:01 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b" returned: 0 in 0.775s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:01 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b Sep 25 16:10:01 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:02 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5.5ddb698a-2559-47a5-9dbf-16a1db8a444b" returned: 0 in 0.368s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-5ddb698a-2559-47a5-9dbf-16a1db8a444b" released by "_delete_snapshot" :: held 2.983s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-1f159e4e-6999-4339-b08f-d9e184e182e5" released by "delete_snapshot" :: held 3.011s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Created reservations ['8617769d-1ec8-499a-9d1c-d9b8c0f52a9f', '7da35fdb-ba10-42af-8df0-3038df3ab429', '55e3d627-851b-404a-a5de-6213917634a1', 'fa31ce97-2ab6-4677-9a84-e8c94b77cfde'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:02 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Delete snapshot completed successfully. Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a051445-5996-4ab8-8e35-8aafd966e321 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-5ddb698a-2559-47a5-9dbf-16a1db8a444b-delete_snapshot" released by "delete_snapshot" :: held 3.242s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "cinder-1f159e4e-6999-4339-b08f-d9e184e182e5-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-1f159e4e-6999-4339-b08f-d9e184e182e5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "cinder-quobyte-1f159e4e-6999-4339-b08f-d9e184e182e5" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-1f159e4e-6999-4339-b08f-d9e184e182e5" acquired by "delete_volume" :: waited 0.044s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6762e-5756-49f4-be21-35b3592f68c3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:03 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 Sep 25 16:10:03 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:03 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5" returned: 0 in 0.790s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:03 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5 Sep 25 16:10:03 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Flow 'volume_create_manager' (95ced8e1-cef5-4af2-b4ce-b63d39508c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d6698a-228b-4187-83e5-cd58396c82f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d6698a-228b-4187-83e5-cd58396c82f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-597020844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5cd049-3be7-464c-8098-6cd76df617a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795ac4e6c20d4e6e8ec05c588bfd63d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:04Z,use_quota=True,user_id='d4fff025a2674d6b978746dcaa78d1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae9adb5-849d-4ba1-9346-6fb87feed64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae9adb5-849d-4ba1-9346-6fb87feed64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6796375c-a0bd-4a9e-9f69-0879f86969d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6796375c-a0bd-4a9e-9f69-0879f86969d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5cd049-3be7-464c-8098-6cd76df617a0', 'volume_name': 'volume-dc5cd049-3be7-464c-8098-6cd76df617a0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da86b0f-2c51-4dca-9ad8-8e236a9fab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da86b0f-2c51-4dca-9ad8-8e236a9fab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f6636-76d9-44df-a59b-4bfaf9079c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:04 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Volume dc5cd049-3be7-464c-8098-6cd76df617a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5cd049-3be7-464c-8098-6cd76df617a0', 'volume_size': 1} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-597020844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5cd049-3be7-464c-8098-6cd76df617a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795ac4e6c20d4e6e8ec05c588bfd63d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:04Z,use_quota=True,user_id='d4fff025a2674d6b978746dcaa78d1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Creating volume dc5cd049-3be7-464c-8098-6cd76df617a0 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:04 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:04 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1f159e4e-6999-4339-b08f-d9e184e182e5" returned: 0 in 0.710s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:04 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 1073741824 Sep 25 16:10:04 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-quobyte-1f159e4e-6999-4339-b08f-d9e184e182e5" released by "delete_volume" :: held 1.632s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Created reservations ['4ad4e8ef-404b-48fb-8aad-84fa3f8ee83b', '4eec181f-766e-4ce9-b5fd-07efbdd3a425', '9e79c924-a965-4e73-897e-286348aaa00c', '99bc0dc7-6efe-49a3-bf2a-875558740484'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:04 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:10:04 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:05 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:05 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.813s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 1073741824" returned: 0 in 1.130s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:05 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Deleted volume successfully. Sep 25 16:10:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fe7cde58-2be4-4ae9-ad24-9d23d7afa968 tempest-VolumesExtendTest-1801925586 None] Lock "cinder-1f159e4e-6999-4339-b08f-d9e184e182e5-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:05 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 Sep 25 16:10:05 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:06 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0" returned: 0 in 0.508s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f6636-76d9-44df-a59b-4bfaf9079c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5cd049-3be7-464c-8098-6cd76df617a0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f19fc4f-12e8-4c41-bc80-248b0d75927a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:06 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Volume volume-dc5cd049-3be7-464c-8098-6cd76df617a0 (dc5cd049-3be7-464c-8098-6cd76df617a0): created successfully Sep 25 16:10:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f19fc4f-12e8-4c41-bc80-248b0d75927a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Flow 'volume_create_manager' (95ced8e1-cef5-4af2-b4ce-b63d39508c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fb937a64-c4ce-4ab8-8073-53d0aca768ce tempest-AttachVolumeShelveTestJSON-1505967025 None] Created volume successfully. Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:15 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:10:15 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:15 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.567s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:10:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:10:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:10:16 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=86,cinder:DELETE=6,cinder:SELECT=85,cinder:INSERT=29 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:16 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=65,cinder:UPDATE=60,cinder:INSERT=26,cinder:DELETE=3 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:22 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-1d5c1c69-fab7-4d2a-bd4d-84e30bf3b4e3 req-4e769efe-37e6-491f-8685-c6996406bbc8 tempest-ServerActionsTestOtherA-620061493 None] Terminate volume connection completed successfully. Sep 25 16:10:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-1d5c1c69-fab7-4d2a-bd4d-84e30bf3b4e3 req-4e769efe-37e6-491f-8685-c6996406bbc8 tempest-ServerActionsTestOtherA-620061493 None] Deleting attachment b65ee54c-3900-405f-ad49-cbaef06470d7. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:10:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-1d5c1c69-fab7-4d2a-bd4d-84e30bf3b4e3 req-3556b86b-934b-485b-a0da-5a6bf869804c tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-1d5c1c69-fab7-4d2a-bd4d-84e30bf3b4e3 req-3556b86b-934b-485b-a0da-5a6bf869804c tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-1d5c1c69-fab7-4d2a-bd4d-84e30bf3b4e3 req-3556b86b-934b-485b-a0da-5a6bf869804c tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-1d5c1c69-fab7-4d2a-bd4d-84e30bf3b4e3 req-3556b86b-934b-485b-a0da-5a6bf869804c tempest-ServerActionsTestOtherA-620061493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8b7a06e-0e8d-4a2f-8988-544c56da5eaf', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:10:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-1d5c1c69-fab7-4d2a-bd4d-84e30bf3b4e3 req-3556b86b-934b-485b-a0da-5a6bf869804c tempest-ServerActionsTestOtherA-620061493 None] attachment_update completed successfully. Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-5aeacec4-065f-4b06-b1b5-23f457fef1f4 req-77d8e3d8-533c-432b-aae0-5e082b71b90e tempest-AttachVolumeShelveTestJSON-1505967025 None] No connector for attachment 277c181e-036d-4ed4-a240-088f15178a8a; skipping storage backend terminate_connection call. {{(pid=87467) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-5aeacec4-065f-4b06-b1b5-23f457fef1f4 req-77d8e3d8-533c-432b-aae0-5e082b71b90e tempest-AttachVolumeShelveTestJSON-1505967025 None] Deleting attachment 277c181e-036d-4ed4-a240-088f15178a8a. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Flow 'volume_create_manager' (170465f9-cd24-4a47-acc9-206b4e78cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce21de0-debe-40c9-be1b-201bff01c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce21de0-debe-40c9-be1b-201bff01c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1427895785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0069a10f-42a2-400d-8cb9-f5e8f2de2922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd81f02067747c3b63395f4a24ab3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:32Z,use_quota=True,user_id='e2f1f3577aab4a3b9e65b92a947de16c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9a2d09-4ff8-4608-9c21-9e2879d7ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9a2d09-4ff8-4608-9c21-9e2879d7ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddee6b2-4501-4015-8c85-0c2bbaf72e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddee6b2-4501-4015-8c85-0c2bbaf72e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0069a10f-42a2-400d-8cb9-f5e8f2de2922', 'volume_name': 'volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f61c658-4cff-402d-8ea7-f23a0db7bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f61c658-4cff-402d-8ea7-f23a0db7bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3fc0fa-68fc-4baa-b91b-b2ddbca41695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:32 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Volume 0069a10f-42a2-400d-8cb9-f5e8f2de2922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922', 'volume_size': 1} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1427895785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0069a10f-42a2-400d-8cb9-f5e8f2de2922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd81f02067747c3b63395f4a24ab3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:32Z,use_quota=True,user_id='e2f1f3577aab4a3b9e65b92a947de16c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Creating volume 0069a10f-42a2-400d-8cb9-f5e8f2de2922 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:32 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:10:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:32 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 1073741824 Sep 25 16:10:32 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:33 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 1073741824" returned: 0 in 0.863s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:33 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 Sep 25 16:10:33 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:33 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922" returned: 0 in 0.421s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3fc0fa-68fc-4baa-b91b-b2ddbca41695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93c074d-6cc9-4f36-95eb-199100787f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:33 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Volume volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 (0069a10f-42a2-400d-8cb9-f5e8f2de2922): created successfully Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93c074d-6cc9-4f36-95eb-199100787f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Flow 'volume_create_manager' (170465f9-cd24-4a47-acc9-206b4e78cc87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-62432d4c-0622-4ebc-8bf4-85cdec2a5dba tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Created volume successfully. Sep 25 16:10:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Acquiring lock "cinder-0069a10f-42a2-400d-8cb9-f5e8f2de2922-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "cinder-0069a10f-42a2-400d-8cb9-f5e8f2de2922-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Acquiring lock "cinder-quobyte-0069a10f-42a2-400d-8cb9-f5e8f2de2922" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "cinder-quobyte-0069a10f-42a2-400d-8cb9-f5e8f2de2922" acquired by "delete_volume" :: waited 0.046s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:37 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d56baad-b1a4-4531-85d1-bd3850b16370]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:37 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 Sep 25 16:10:37 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:38 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922" returned: 0 in 0.986s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:38 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922 Sep 25 16:10:38 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:38 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0069a10f-42a2-400d-8cb9-f5e8f2de2922" returned: 0 in 0.526s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "cinder-quobyte-0069a10f-42a2-400d-8cb9-f5e8f2de2922" released by "delete_volume" :: held 1.652s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:38 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Created reservations ['4be295c4-3a86-4323-9771-e92acd0623a2', 'e9e556ab-d16e-4b86-81f1-edaa843bc2d9', 'c625d125-552d-4bac-95e3-9b266e3bd9cf', '3a82c34d-a88d-4706-80c4-4648a3485fe3'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:39 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:10:39 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:39 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.663s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:10:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Deleted volume successfully. Sep 25 16:10:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c862cb7e-8522-4e93-bf01-2cebdccc9cf3 tempest-VolumeQuotasNegativeTestJSON-1140411551 None] Lock "cinder-0069a10f-42a2-400d-8cb9-f5e8f2de2922-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:49 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:49 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (a420d0f7-501c-4fc4-9691-04e53f515934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63de86a-bc6e-41b5-80dd-6cb50f9dfa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:49 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63de86a-bc6e-41b5-80dd-6cb50f9dfa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-467417912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e6f052-f620-47bb-8cb0-ace2fc29ec81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:50Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e787fa25-e208-4890-a0e7-7e5f580e34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e787fa25-e208-4890-a0e7-7e5f580e34dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf1b828-f10d-4c04-99d2-c3f35277b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf1b828-f10d-4c04-99d2-c3f35277b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e6f052-f620-47bb-8cb0-ace2fc29ec81', 'volume_name': 'volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3155d0d0-f179-404c-b3bd-2ded28b6d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3155d0d0-f179-404c-b3bd-2ded28b6d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561ae048-7ca1-4e32-81b6-e1a717b43267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Volume 46e6f052-f620-47bb-8cb0-ace2fc29ec81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81', 'volume_size': 1} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-467417912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e6f052-f620-47bb-8cb0-ace2fc29ec81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:50Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Creating volume 46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:50 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 1073741824 Sep 25 16:10:50 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:50 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 1073741824" returned: 0 in 0.792s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:51 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 Sep 25 16:10:51 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:51 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81" returned: 0 in 0.486s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561ae048-7ca1-4e32-81b6-e1a717b43267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e631f155-0e44-4411-985c-aa9d61851d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Volume volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 (46e6f052-f620-47bb-8cb0-ace2fc29ec81): created successfully Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e631f155-0e44-4411-985c-aa9d61851d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (a420d0f7-501c-4fc4-9691-04e53f515934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-867d3f87-71c4-4263-b729-81b3d7f23890 tempest-VolumesSnapshotTestJSON-906571138 None] Created volume successfully. Sep 25 16:10:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Creating offline snapshot 6b6cc683-0d47-42c2-870f-72537b486b67 of volume 46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:10:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5696d074-5cf4-468f-9b4e-6c778a9b2640]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:52 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 Sep 25 16:10:52 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:53 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81" returned: 0 in 0.615s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:53 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 1G Sep 25 16:10:53 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 1G" returned: 0 in 0.835s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:54 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 Sep 25 16:10:54 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:54 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Flow 'volume_create_manager' (cd37a1ec-9cee-40bb-b505-8ca1e3b46c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0151d877-0aff-4d09-8b4a-debd03a4fde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:55 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67" returned: 0 in 0.767s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:55 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 is being set with open permissions: ugo+rw Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0151d877-0aff-4d09-8b4a-debd03a4fde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-735852640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6166b67-49de-4ac3-a865-5495d59d52ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5e0d2c47b344d0b32310f6f8be31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:55Z,use_quota=True,user_id='05b6a92a5bea4f90bad253e723c7d232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:55 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 Sep 25 16:10:55 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced08005-4781-44cf-af68-36399d6e9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced08005-4781-44cf-af68-36399d6e9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90597a1f-bb24-4871-9d17-41056044bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90597a1f-bb24-4871-9d17-41056044bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6166b67-49de-4ac3-a865-5495d59d52ce', 'volume_name': 'volume-c6166b67-49de-4ac3-a865-5495d59d52ce', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891d3719-377b-4587-929e-ddc4ed045c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891d3719-377b-4587-929e-ddc4ed045c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5871d5ff-b92d-48f5-a1ba-abc679600cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:55 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Volume c6166b67-49de-4ac3-a865-5495d59d52ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6166b67-49de-4ac3-a865-5495d59d52ce', 'volume_size': 1} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:55 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67" returned: 0 in 0.515s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:55 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.info Sep 25 16:10:55 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.info" returned: 0 in 0.505s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.info is being set with open permissions: ugo+rw Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.info Sep 25 16:10:56 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.info" returned: 0 in 0.405s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.844s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-735852640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6166b67-49de-4ac3-a865-5495d59d52ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5e0d2c47b344d0b32310f6f8be31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:10:55Z,use_quota=True,user_id='05b6a92a5bea4f90bad253e723c7d232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Creating volume c6166b67-49de-4ac3-a865-5495d59d52ce {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:10:56 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:10:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:56 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce 1073741824 Sep 25 16:10:56 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ceef9806-40e2-447f-aeaa-1d0d9a5314ea tempest-VolumesSnapshotTestJSON-906571138 None] Create snapshot completed successfully Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-6b6cc683-0d47-42c2-870f-72537b486b67-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-6b6cc683-0d47-42c2-870f-72537b486b67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:57 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce 1073741824" returned: 0 in 0.776s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-46e6f052-f620-47bb-8cb0-ace2fc29ec81" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-46e6f052-f620-47bb-8cb0-ace2fc29ec81" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-6b6cc683-0d47-42c2-870f-72537b486b67" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:57 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-6b6cc683-0d47-42c2-870f-72537b486b67" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:57 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Deleting offline snapshot 6b6cc683-0d47-42c2-870f-72537b486b67 of volume 46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] snapshot_file for this snap is: volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff9be03-e682-4a78-8a7f-ea1d9fdbf61b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:57 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 Sep 25 16:10:57 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:57 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce" returned: 0 in 0.326s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5871d5ff-b92d-48f5-a1ba-abc679600cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6166b67-49de-4ac3-a865-5495d59d52ce', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62638e6-5efb-45f4-ac52-c8bc9788fc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:10:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Volume volume-c6166b67-49de-4ac3-a865-5495d59d52ce (c6166b67-49de-4ac3-a865-5495d59d52ce): created successfully Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62638e6-5efb-45f4-ac52-c8bc9788fc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:10:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Flow 'volume_create_manager' (cd37a1ec-9cee-40bb-b505-8ca1e3b46c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:10:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ba0b73e9-44e4-4bdd-b0b0-cc19f14e4c9e tempest-VolumesServicesTestJSON-1151044459 None] Created volume successfully. Sep 25 16:10:58 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67" returned: 0 in 0.596s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a869bd5-d220-4765-a778-30f2022054df]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Acquiring lock "cinder-c6166b67-49de-4ac3-a865-5495d59d52ce-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:58 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 Sep 25 16:10:58 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Lock "cinder-c6166b67-49de-4ac3-a865-5495d59d52ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Acquiring lock "cinder-quobyte-c6166b67-49de-4ac3-a865-5495d59d52ce" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Lock "cinder-quobyte-c6166b67-49de-4ac3-a865-5495d59d52ce" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9785b37-da3f-4160-a887-7d311241eea8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:58 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81" returned: 0 in 0.672s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:58 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce Sep 25 16:10:58 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:58 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 Sep 25 16:10:58 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:59 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce" returned: 0 in 0.773s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:59 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce Sep 25 16:10:59 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:59 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67" returned: 0 in 0.698s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:59 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67 Sep 25 16:10:59 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:10:59 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6166b67-49de-4ac3-a865-5495d59d52ce" returned: 0 in 0.364s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Lock "cinder-quobyte-c6166b67-49de-4ac3-a865-5495d59d52ce" released by "delete_volume" :: held 1.256s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Created reservations ['66bfcb47-c8fa-4649-b4df-1d231130b238', '83201c5c-bfe2-4d93-af3a-d6c750974bde', 'e7bd58b5-4c49-46d1-a8f5-728377436da5', 'de26c54a-270f-4b89-8f07-90323eaa2703'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:10:59 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 25 16:10:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81.6b6cc683-0d47-42c2-870f-72537b486b67" returned: 0 in 0.342s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:10:59 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:10:59 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-6b6cc683-0d47-42c2-870f-72537b486b67" released by "_delete_snapshot" :: held 2.541s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-46e6f052-f620-47bb-8cb0-ace2fc29ec81" released by "delete_snapshot" :: held 2.588s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:00 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['d0df00df-a24f-4eb4-b257-459453979946', 'fd6ed044-5649-4bf2-a986-56a2d11ce365', '38f18738-b2d4-4571-a6f7-77f1c9038c07', '2067e863-4736-4248-95fd-4dceaa3be0d3'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Delete snapshot completed successfully. Sep 25 16:11:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b43977de-e391-4efe-b5b7-e807a9b31def tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-6b6cc683-0d47-42c2-870f-72537b486b67-delete_snapshot" released by "delete_snapshot" :: held 2.960s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:00 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.459s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:00 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Deleted volume successfully. Sep 25 16:11:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8d0e3dc5-aa30-4f42-8560-61ad6ab35841 tempest-VolumesServicesTestJSON-1151044459 None] Lock "cinder-c6166b67-49de-4ac3-a865-5495d59d52ce-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (ba475881-5d0f-460c-b592-73f12bb178bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e343b0-cc96-481d-a361-ed6e5231ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e343b0-cc96-481d-a361-ed6e5231ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-980631877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85f1772-9289-4e41-a421-d52791b7e12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:01Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6307e1da-9d50-4749-8a6c-fa895412cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6307e1da-9d50-4749-8a6c-fa895412cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8178ef1f-b6d2-4e0a-9c90-6bb0405f8995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8178ef1f-b6d2-4e0a-9c90-6bb0405f8995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85f1772-9289-4e41-a421-d52791b7e12b', 'volume_name': 'volume-c85f1772-9289-4e41-a421-d52791b7e12b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31eacec-b057-44a5-bf51-dc2a86fe338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31eacec-b057-44a5-bf51-dc2a86fe338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff8b75c-994d-4da2-9359-8ab3dafe9ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:01 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Volume c85f1772-9289-4e41-a421-d52791b7e12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85f1772-9289-4e41-a421-d52791b7e12b', 'volume_size': 1} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-980631877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85f1772-9289-4e41-a421-d52791b7e12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:01Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Creating volume c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:01 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:11:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:01 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b 1073741824 Sep 25 16:11:01 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:02 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b 1073741824" returned: 0 in 0.676s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:02 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b Sep 25 16:11:02 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:03 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b" returned: 0 in 0.429s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff8b75c-994d-4da2-9359-8ab3dafe9ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85f1772-9289-4e41-a421-d52791b7e12b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40a6510-a34e-4820-974f-a227c56a2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:03 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Volume volume-c85f1772-9289-4e41-a421-d52791b7e12b (c85f1772-9289-4e41-a421-d52791b7e12b): created successfully Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40a6510-a34e-4820-974f-a227c56a2da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (ba475881-5d0f-460c-b592-73f12bb178bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:03 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-65090245-2556-413e-8245-a380224cff5f tempest-VolumesSnapshotTestJSON-906571138 None] Created volume successfully. Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Creating offline snapshot 5fdd8874-48a5-43f0-b472-2fea6c2c88ab of volume c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:11:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b533b80f-baa7-4a28-b3ce-58ee1c46fa80]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:04 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b Sep 25 16:11:04 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:04 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b" returned: 0 in 0.639s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:04 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab 1G Sep 25 16:11:04 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:05 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab 1G" returned: 0 in 0.541s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85f1772-9289-4e41-a421-d52791b7e12b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:05 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85f1772-9289-4e41-a421-d52791b7e12b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab Sep 25 16:11:05 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:05 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85f1772-9289-4e41-a421-d52791b7e12b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab" returned: 0 in 0.552s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:05 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab is being set with open permissions: ugo+rw Sep 25 16:11:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:05 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab Sep 25 16:11:05 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:06 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab" returned: 0 in 0.400s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:06 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.info Sep 25 16:11:06 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:06 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.info" returned: 0 in 0.385s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:06 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.info is being set with open permissions: ugo+rw Sep 25 16:11:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:06 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.info Sep 25 16:11:06 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:07 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.info" returned: 0 in 0.429s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.104s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:07 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a9436dca-6be7-4978-814c-52d086f8258a tempest-VolumesSnapshotTestJSON-906571138 None] Create snapshot completed successfully Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (ee37775e-0017-44ee-a8f8-18aa93064651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32a8b10-cb20-4750-b866-437f0a0f0787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32a8b10-cb20-4750-b866-437f0a0f0787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-565017504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374f5b56-0a47-40c2-81ca-624c41b60150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5fdd8874-48a5-43f0-b472-2fea6c2c88ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:09Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da862877-974c-4beb-be77-f61fd669d26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da862877-974c-4beb-be77-f61fd669d26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1196c9-3f4c-470f-9d69-306be7cd0c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1196c9-3f4c-470f-9d69-306be7cd0c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '374f5b56-0a47-40c2-81ca-624c41b60150', 'volume_name': 'volume-374f5b56-0a47-40c2-81ca-624c41b60150', 'volume_size': 2, 'snapshot_id': '5fdd8874-48a5-43f0-b472-2fea6c2c88ab'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b88a84d-45a0-453c-b18f-29ead829f850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b88a84d-45a0-453c-b18f-29ead829f850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a83a479-6ad4-4adc-b448-ba78b8dae026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Volume 374f5b56-0a47-40c2-81ca-624c41b60150: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-374f5b56-0a47-40c2-81ca-624c41b60150', 'volume_size': 2, 'snapshot_id': '5fdd8874-48a5-43f0-b472-2fea6c2c88ab'} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-5fdd8874-48a5-43f0-b472-2fea6c2c88ab-374f5b56-0a47-40c2-81ca-624c41b60150" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-5fdd8874-48a5-43f0-b472-2fea6c2c88ab-374f5b56-0a47-40c2-81ca-624c41b60150" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Creating volume 374f5b56-0a47-40c2-81ca-624c41b60150 from snapshot 5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-374f5b56-0a47-40c2-81ca-624c41b60150" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-374f5b56-0a47-40c2-81ca-624c41b60150" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] snapshot: 5fdd8874-48a5-43f0-b472-2fea6c2c88ab, volume: 374f5b56-0a47-40c2-81ca-624c41b60150, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Flow 'volume_create_manager' (0f7d705a-9850-4229-b4a4-bc9dacbde61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7683bfd4-938c-43cb-881f-116e94cdb804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ecdc05-9551-4e26-ac0d-23866bb2a209]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7683bfd4-938c-43cb-881f-116e94cdb804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1289943663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022775e9-6915-47f9-977d-27cb2fa67e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3190d1cccad4914a2d31af228f360ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:10Z,use_quota=True,user_id='eb4e4cb7ca8f4c8a980ae21a997008cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35d6adc8-3547-44fc-826d-1b06f2a30e6e),volume_type_id=35d6adc8-3547-44fc-826d-1b06f2a30e6e)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249a14bf-4d5e-4224-8e2e-8dca4315c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249a14bf-4d5e-4224-8e2e-8dca4315c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a511647-7e13-4773-9b98-188b8d8f134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a511647-7e13-4773-9b98-188b8d8f134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022775e9-6915-47f9-977d-27cb2fa67e59', 'volume_name': 'volume-022775e9-6915-47f9-977d-27cb2fa67e59', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5dd091-2e6e-4a13-938a-cbb7481bf983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5dd091-2e6e-4a13-938a-cbb7481bf983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23c54f3-aeb6-4f2e-8c70-b23c90ffd475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:09 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Volume 022775e9-6915-47f9-977d-27cb2fa67e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022775e9-6915-47f9-977d-27cb2fa67e59', 'volume_size': 1} Sep 25 16:11:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:09 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab Sep 25 16:11:09 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:10 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab" returned: 0 in 0.473s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c85f1772-9289-4e41-a421-d52791b7e12b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4254f2-c8e2-410e-afa4-0469190e085b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:10 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b Sep 25 16:11:10 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:10 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b" returned: 0 in 0.603s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:11:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:10 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 Sep 25 16:11:10 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:14 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-86447108-107d-43a6-bab0-548bbda964d6 tempest-ServerActionsTestOtherA-620061493 None] Terminate volume connection completed successfully. Sep 25 16:11:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-86447108-107d-43a6-bab0-548bbda964d6 tempest-ServerActionsTestOtherA-620061493 None] Deleting attachment c8b7a06e-0e8d-4a2f-8988-544c56da5eaf. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "cinder-4eaca1ee-1575-4b04-a46b-e51e6db307c2-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-4eaca1ee-1575-4b04-a46b-e51e6db307c2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "cinder-quobyte-4eaca1ee-1575-4b04-a46b-e51e6db307c2" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-quobyte-4eaca1ee-1575-4b04-a46b-e51e6db307c2" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6831f2c-b27b-43e1-a953-60db39568dc3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:15 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:15 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:15 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 Sep 25 16:11:15 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:16 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.889s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:11:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:11:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:11:16 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2" returned: 0 in 1.149s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:16 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2 Sep 25 16:11:16 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:17 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4eaca1ee-1575-4b04-a46b-e51e6db307c2" returned: 0 in 0.517s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-quobyte-4eaca1ee-1575-4b04-a46b-e51e6db307c2" released by "delete_volume" :: held 1.829s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.quota [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Created reservations ['72808911-7e0c-4e52-ae9a-bfbc0813e7bf', 'd63a1d07-516d-4de9-bb7c-4c4dfe3134e2', 'a4fdbb41-5a7a-475d-b82a-7d557c197ec0', '0383dafa-709a-4b43-9f27-af4b53d99a54'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "cinder-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "cinder-quobyte-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:17 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:17 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-quobyte-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8548d49d-1dfb-4dae-9d15-dcd53f5b2486]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:17 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 Sep 25 16:11:17 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:18 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.491s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:18 devstack cinder-volume[87467]: DEBUG cinder.manager [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Deleted volume successfully. Sep 25 16:11:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-c07c03b3-5ffe-4406-aada-b3bdab07c933 req-5ff76577-c803-45fe-98a0-a0cdd80df4f5 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-4eaca1ee-1575-4b04-a46b-e51e6db307c2-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:18 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2" returned: 0 in 1.000s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:18 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2 Sep 25 16:11:18 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:19 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2" returned: 0 in 0.510s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-quobyte-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2" released by "delete_volume" :: held 1.609s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Created reservations ['fa736531-688a-4c83-a287-fc61b2c903c6', '8951caaf-f1c8-478d-b253-568e737d49e5', '7effa2f8-0d49-4ec1-ae14-807281f26038', 'eb31bf7a-d500-4576-bcdb-779460bd2bd7'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:19 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:19 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:20 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.626s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:20 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Deleted volume successfully. Sep 25 16:11:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41544d09-e64e-4aa9-9c37-ff168cc82bd1 tempest-ServerActionsTestOtherA-620061493 None] Lock "cinder-0f5c697d-c267-4f54-87d9-7c8cfdfbeaa2-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:21 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150" returned: 0 in 10.317s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:11:21 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Converted 1024.00 MB image at 99.24 MB/s Sep 25 16:11:21 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 is being set with open permissions: ugo+rw Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:21 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 Sep 25 16:11:21 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:21 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150" returned: 0 in 0.362s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-374f5b56-0a47-40c2-81ca-624c41b60150" released by "_copy_volume_from_snapshot" :: held 11.900s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-5fdd8874-48a5-43f0-b472-2fea6c2c88ab-374f5b56-0a47-40c2-81ca-624c41b60150" released by "_create_volume_from_snapshot" :: held 12.023s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.047s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.764s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1289943663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022775e9-6915-47f9-977d-27cb2fa67e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3190d1cccad4914a2d31af228f360ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:10Z,use_quota=True,user_id='eb4e4cb7ca8f4c8a980ae21a997008cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35d6adc8-3547-44fc-826d-1b06f2a30e6e),volume_type_id=35d6adc8-3547-44fc-826d-1b06f2a30e6e)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Creating volume 022775e9-6915-47f9-977d-27cb2fa67e59 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:21 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:21 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 1073741824 Sep 25 16:11:21 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a83a479-6ad4-4adc-b448-ba78b8dae026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374f5b56-0a47-40c2-81ca-624c41b60150', 'volume_size': 2, 'snapshot_id': '5fdd8874-48a5-43f0-b472-2fea6c2c88ab'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e73f2c-c1df-4938-b857-1041507c0e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Volume volume-374f5b56-0a47-40c2-81ca-624c41b60150 (374f5b56-0a47-40c2-81ca-624c41b60150): created successfully Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e73f2c-c1df-4938-b857-1041507c0e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (ee37775e-0017-44ee-a8f8-18aa93064651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-548fafc9-4abd-453b-bdd1-2b42ba5dfa8d tempest-VolumesSnapshotTestJSON-906571138 None] Created volume successfully. Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-374f5b56-0a47-40c2-81ca-624c41b60150-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-374f5b56-0a47-40c2-81ca-624c41b60150-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-374f5b56-0a47-40c2-81ca-624c41b60150" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-374f5b56-0a47-40c2-81ca-624c41b60150" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b563eef-cbd3-4c47-ab90-81a1df2e4cc8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:22 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 1073741824" returned: 0 in 0.985s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:22 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 Sep 25 16:11:22 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:22 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 Sep 25 16:11:22 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:23 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150" returned: 0 in 0.680s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:23 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150 Sep 25 16:11:23 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:23 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59" returned: 0 in 0.432s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23c54f3-aeb6-4f2e-8c70-b23c90ffd475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022775e9-6915-47f9-977d-27cb2fa67e59', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae06670-c312-4ce2-a11d-9148bbd36fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:23 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Volume volume-022775e9-6915-47f9-977d-27cb2fa67e59 (022775e9-6915-47f9-977d-27cb2fa67e59): created successfully Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae06670-c312-4ce2-a11d-9148bbd36fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Flow 'volume_create_manager' (0f7d705a-9850-4229-b4a4-bc9dacbde61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e5148381-4767-460e-b72c-a711609527ba tempest-VolumeTypesAccessTest-1545392386 None] Created volume successfully. Sep 25 16:11:23 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-374f5b56-0a47-40c2-81ca-624c41b60150" returned: 0 in 0.635s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-374f5b56-0a47-40c2-81ca-624c41b60150" released by "delete_volume" :: held 1.419s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Acquiring lock "cinder-022775e9-6915-47f9-977d-27cb2fa67e59-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['95800213-5bb5-4b0f-b5a4-dce907f9d32f', '9051a32b-a359-4414-9603-b3ff4d469bda', '47df4e51-3621-41a0-91e9-fe5903895ea0', 'cb22dde5-2ae7-45d5-8c5b-be6dfd7eabff'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Lock "cinder-022775e9-6915-47f9-977d-27cb2fa67e59-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Acquiring lock "cinder-quobyte-022775e9-6915-47f9-977d-27cb2fa67e59" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Lock "cinder-quobyte-022775e9-6915-47f9-977d-27cb2fa67e59" acquired by "delete_volume" :: waited 0.048s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0184ade8-d010-4fde-9389-e3969dc60ee5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:24 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:24 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 Sep 25 16:11:24 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.393s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Deleted volume successfully. Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-601eb72a-7f02-4b3d-801c-ccdb6cf55e59 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-374f5b56-0a47-40c2-81ca-624c41b60150-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:24 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59" returned: 0 in 0.565s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-5fdd8874-48a5-43f0-b472-2fea6c2c88ab-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:24 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59 Sep 25 16:11:24 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-5fdd8874-48a5-43f0-b472-2fea6c2c88ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-c85f1772-9289-4e41-a421-d52791b7e12b" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-c85f1772-9289-4e41-a421-d52791b7e12b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-5fdd8874-48a5-43f0-b472-2fea6c2c88ab" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-5fdd8874-48a5-43f0-b472-2fea6c2c88ab" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Deleting offline snapshot 5fdd8874-48a5-43f0-b472-2fea6c2c88ab of volume c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] snapshot_file for this snap is: volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b337f8-fef3-4807-87b7-75337bab8c39]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:25 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab Sep 25 16:11:25 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:25 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-022775e9-6915-47f9-977d-27cb2fa67e59" returned: 0 in 0.353s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Lock "cinder-quobyte-022775e9-6915-47f9-977d-27cb2fa67e59" released by "delete_volume" :: held 1.021s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:25 devstack cinder-volume[87467]: WARNING cinder.quota [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-133299446 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-133299446, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:11:25 devstack cinder-volume[87467]: WARNING cinder.quota [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-133299446 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-133299446, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Created reservations ['6b893394-1300-4bc3-baef-41eb64a13bea', '4d2666b4-0c07-4169-8d35-5a8a3e5d331b', '66ee7bf9-76a6-4f47-9665-95377a2dd558', '08db8664-fa66-4182-940c-a79e6bba6576'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:25 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:25 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:25 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab" returned: 0 in 0.540s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c85f1772-9289-4e41-a421-d52791b7e12b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[16799944-e02d-43bf-bd31-0724128acfce]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:25 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.353s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Deleted volume successfully. Sep 25 16:11:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4683bb7-cf62-4619-9ad5-e145541844e6 tempest-VolumeTypesAccessTest-1545392386 None] Lock "cinder-022775e9-6915-47f9-977d-27cb2fa67e59-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:25 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b Sep 25 16:11:25 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:26 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b" returned: 0 in 0.762s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:26 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab Sep 25 16:11:26 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:26 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab" returned: 0 in 0.533s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:26 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab Sep 25 16:11:26 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:27 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b.5fdd8874-48a5-43f0-b472-2fea6c2c88ab" returned: 0 in 0.361s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-5fdd8874-48a5-43f0-b472-2fea6c2c88ab" released by "_delete_snapshot" :: held 2.368s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-c85f1772-9289-4e41-a421-d52791b7e12b" released by "delete_snapshot" :: held 2.400s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:27 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['0b6e17fd-d001-4803-b4ac-0fded07179fb', 'f9a31925-6cec-4973-982e-1efe3a41a345', '69eaf10e-9246-4b84-9f88-fdf91c4d2118', 'c741391f-cff6-4193-9d31-cdcf48487ac4'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:27 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Delete snapshot completed successfully. Sep 25 16:11:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cac573c7-f814-4528-8944-259d43c0a09f tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-5fdd8874-48a5-43f0-b472-2fea6c2c88ab-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-c85f1772-9289-4e41-a421-d52791b7e12b-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-c85f1772-9289-4e41-a421-d52791b7e12b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-c85f1772-9289-4e41-a421-d52791b7e12b" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-c85f1772-9289-4e41-a421-d52791b7e12b" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0cd220-8684-47e8-a83b-9b4bf8d35e3d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:28 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b Sep 25 16:11:28 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:28 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b" returned: 0 in 0.566s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:28 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b Sep 25 16:11:28 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:29 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c85f1772-9289-4e41-a421-d52791b7e12b" returned: 0 in 0.358s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-c85f1772-9289-4e41-a421-d52791b7e12b" released by "delete_volume" :: held 1.030s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['35cb42fb-6a50-463c-9668-87d0f05e326e', '994f50b7-c5ea-469b-b463-660b2199cb9e', 'b45912e1-1dbc-4780-bd8f-92bc79b4605d', 'd92c199a-c0ab-40a2-9941-7d446b272e49'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:29 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:29 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:29 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.340s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Deleted volume successfully. Sep 25 16:11:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5c9b3a-2e56-4e30-b134-ac4899b59c5c tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-c85f1772-9289-4e41-a421-d52791b7e12b-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (579c39b2-5534-47bb-8691-56f2bdee4c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555165f-c307-4a5b-aa2a-0d934041520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555165f-c307-4a5b-aa2a-0d934041520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-984908342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5ffe02-1f5a-41ca-9906-f8640ab75339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:31Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dacb48-863c-4c90-b911-bf80f6938de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dacb48-863c-4c90-b911-bf80f6938de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91b5553-9c8c-425e-b96b-ae27f00a0493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91b5553-9c8c-425e-b96b-ae27f00a0493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5ffe02-1f5a-41ca-9906-f8640ab75339', 'volume_name': 'volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ccacb4-13e4-4626-bded-5e8cc251f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ccacb4-13e4-4626-bded-5e8cc251f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0262b0fc-0cec-400c-b64f-7728517c6532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:31 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Volume ba5ffe02-1f5a-41ca-9906-f8640ab75339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339', 'volume_size': 1} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-984908342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5ffe02-1f5a-41ca-9906-f8640ab75339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:31Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Creating volume ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:31 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:31 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 1073741824 Sep 25 16:11:31 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:31 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 1073741824" returned: 0 in 0.624s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:32 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 Sep 25 16:11:32 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:32 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339" returned: 0 in 0.307s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0262b0fc-0cec-400c-b64f-7728517c6532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96da5e99-4dcf-4f95-9598-a0041f80002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:32 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Volume volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 (ba5ffe02-1f5a-41ca-9906-f8640ab75339): created successfully Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96da5e99-4dcf-4f95-9598-a0041f80002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (579c39b2-5534-47bb-8691-56f2bdee4c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:32 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0dacfa0a-3965-40f2-a950-82a41c92a76a tempest-VolumesSnapshotTestJSON-906571138 None] Created volume successfully. Sep 25 16:11:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Creating offline snapshot 725923fb-ef75-4e1b-9fe4-6598ebd9b226 of volume ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:11:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d5078-d025-40f0-b5d2-2f4ceee2ab69]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:33 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 Sep 25 16:11:33 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:34 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339" returned: 0 in 0.634s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:34 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 1G Sep 25 16:11:34 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:35 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 1G" returned: 0 in 0.828s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:35 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 Sep 25 16:11:35 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:35 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226" returned: 0 in 0.676s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:35 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 is being set with open permissions: ugo+rw Sep 25 16:11:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:35 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 Sep 25 16:11:35 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:36 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226" returned: 0 in 0.428s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:36 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.info Sep 25 16:11:36 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:36 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.info" returned: 0 in 0.515s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:36 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.info is being set with open permissions: ugo+rw Sep 25 16:11:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:36 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.info Sep 25 16:11:36 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:37 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.info" returned: 0 in 0.543s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.801s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-aa69f972-7b5a-4281-a89e-83db35144f2e tempest-VolumesSnapshotTestJSON-906571138 None] Create snapshot completed successfully Sep 25 16:11:38 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (a76581aa-c1ff-45d9-982a-b63cde830427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2d3cb6-f280-4e13-bc90-b2eeb4c82117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2d3cb6-f280-4e13-bc90-b2eeb4c82117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-919488553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9ef687-7761-4e03-a551-60a766c8562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15514580662d4b34b589bb8e0b6ededb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=725923fb-ef75-4e1b-9fe4-6598ebd9b226,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:39Z,use_quota=True,user_id='9bbdb700b9d24b0781dbf5b1a89cecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd583fc-38c0-413f-95fa-6c55c3e5989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd583fc-38c0-413f-95fa-6c55c3e5989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16101b53-6309-48d7-9e71-9158a8c23607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16101b53-6309-48d7-9e71-9158a8c23607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac9ef687-7761-4e03-a551-60a766c8562d', 'volume_name': 'volume-ac9ef687-7761-4e03-a551-60a766c8562d', 'volume_size': 1, 'snapshot_id': '725923fb-ef75-4e1b-9fe4-6598ebd9b226'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6e32c2-6dff-4cd3-9d7b-0cd379313f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6e32c2-6dff-4cd3-9d7b-0cd379313f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb890f41-9d61-4efd-becd-efd832edcf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:39 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Volume ac9ef687-7761-4e03-a551-60a766c8562d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac9ef687-7761-4e03-a551-60a766c8562d', 'volume_size': 1, 'snapshot_id': '725923fb-ef75-4e1b-9fe4-6598ebd9b226'} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-725923fb-ef75-4e1b-9fe4-6598ebd9b226-ac9ef687-7761-4e03-a551-60a766c8562d" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-725923fb-ef75-4e1b-9fe4-6598ebd9b226-ac9ef687-7761-4e03-a551-60a766c8562d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Creating volume ac9ef687-7761-4e03-a551-60a766c8562d from snapshot 725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-ac9ef687-7761-4e03-a551-60a766c8562d" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ac9ef687-7761-4e03-a551-60a766c8562d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] snapshot: 725923fb-ef75-4e1b-9fe4-6598ebd9b226, volume: ac9ef687-7761-4e03-a551-60a766c8562d, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[831adad9-87f6-4b99-88ef-0d53cb8b431a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:39 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 Sep 25 16:11:39 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:39 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226" returned: 0 in 0.503s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f74655d-c2cc-4524-8d5c-2f1873692567]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:39 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 Sep 25 16:11:39 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:40 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339" returned: 0 in 0.580s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:11:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:11:40 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:11:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:40 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d Sep 25 16:11:40 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:48 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:INSERT=16,cinder:UPDATE=75,cinder:DELETE=7,cinder:SELECT=78 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:11:49 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=71,cinder:UPDATE=91,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:11:50 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d" returned: 0 in 10.132s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:11:50 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Converted 1024.00 MB image at 101.03 MB/s Sep 25 16:11:50 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d is being set with open permissions: ugo+rw Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:50 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d Sep 25 16:11:50 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:50 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d" returned: 0 in 0.359s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ac9ef687-7761-4e03-a551-60a766c8562d" released by "_copy_volume_from_snapshot" :: held 11.697s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-725923fb-ef75-4e1b-9fe4-6598ebd9b226-ac9ef687-7761-4e03-a551-60a766c8562d" released by "_create_volume_from_snapshot" :: held 11.812s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.835s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb890f41-9d61-4efd-becd-efd832edcf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9ef687-7761-4e03-a551-60a766c8562d', 'volume_size': 1, 'snapshot_id': '725923fb-ef75-4e1b-9fe4-6598ebd9b226'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e2a144-78a6-42b3-bdb0-1326cce0c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Volume volume-ac9ef687-7761-4e03-a551-60a766c8562d (ac9ef687-7761-4e03-a551-60a766c8562d): created successfully Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e2a144-78a6-42b3-bdb0-1326cce0c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Flow 'volume_create_manager' (a76581aa-c1ff-45d9-982a-b63cde830427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5fb2a93c-76bd-47c5-b1f3-238a6bcde832 tempest-VolumesSnapshotTestJSON-906571138 None] Created volume successfully. Sep 25 16:11:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-ac9ef687-7761-4e03-a551-60a766c8562d-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-ac9ef687-7761-4e03-a551-60a766c8562d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-ac9ef687-7761-4e03-a551-60a766c8562d" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ac9ef687-7761-4e03-a551-60a766c8562d" acquired by "delete_volume" :: waited 0.056s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[18044174-d9c9-4fae-a0db-d46b004f341d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:52 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d Sep 25 16:11:52 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:52 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d" returned: 0 in 0.652s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:52 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d Sep 25 16:11:52 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:53 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac9ef687-7761-4e03-a551-60a766c8562d" returned: 0 in 0.379s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ac9ef687-7761-4e03-a551-60a766c8562d" released by "delete_volume" :: held 1.116s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['34e74b00-5158-46ce-bc10-20fe09d1fa45', 'd1f23338-1a4f-4104-bd62-6332b358ae29', '092980f5-2b28-4210-9172-e745efb72464', 'b89f3c90-23ac-4673-b522-2d2ac0c807c1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:53 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:53 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:53 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.308s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Deleted volume successfully. Sep 25 16:11:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-086087a6-eb3e-48d9-8837-4e4a34ef21ef tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-ac9ef687-7761-4e03-a551-60a766c8562d-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-725923fb-ef75-4e1b-9fe4-6598ebd9b226-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-725923fb-ef75-4e1b-9fe4-6598ebd9b226-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-ba5ffe02-1f5a-41ca-9906-f8640ab75339" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ba5ffe02-1f5a-41ca-9906-f8640ab75339" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-725923fb-ef75-4e1b-9fe4-6598ebd9b226" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-725923fb-ef75-4e1b-9fe4-6598ebd9b226" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Deleting offline snapshot 725923fb-ef75-4e1b-9fe4-6598ebd9b226 of volume ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] snapshot_file for this snap is: volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e6c26-38be-4241-b187-aeb1342703fd]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:54 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 Sep 25 16:11:54 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:55 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226" returned: 0 in 0.615s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb510f92-d4dc-497c-95e4-32e4962f5ab4]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:55 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 Sep 25 16:11:55 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Acquiring lock "cinder-dc5cd049-3be7-464c-8098-6cd76df617a0-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "cinder-dc5cd049-3be7-464c-8098-6cd76df617a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Acquiring lock "cinder-quobyte-dc5cd049-3be7-464c-8098-6cd76df617a0" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "cinder-quobyte-dc5cd049-3be7-464c-8098-6cd76df617a0" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[84528f87-abd8-4d2a-baaa-38a849aa525c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 Sep 25 16:11:56 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:56 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339" returned: 0 in 0.871s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 Sep 25 16:11:56 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:56 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0" returned: 0 in 0.662s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0 Sep 25 16:11:56 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Flow 'volume_create_manager' (665e06a8-0b83-4443-9c57-568d7039162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dee1540-fd33-4cdb-aaa8-bcbc24fa45d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:56 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226" returned: 0 in 0.589s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dee1540-fd33-4cdb-aaa8-bcbc24fa45d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1528554607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e54dc3-8c93-4e80-a872-2197bfa082e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300a2dd2b0854b7d8df961d735c2f41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:57Z,use_quota=True,user_id='9972bf3c710948deb480ab990e58cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ba149-f491-4178-ab57-254d73339142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ba149-f491-4178-ab57-254d73339142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c94a476-36af-4b28-a66b-1e8fa33bc583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:56 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226 Sep 25 16:11:56 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c94a476-36af-4b28-a66b-1e8fa33bc583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e54dc3-8c93-4e80-a872-2197bfa082e9', 'volume_name': 'volume-03e54dc3-8c93-4e80-a872-2197bfa082e9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e75fcc4-800d-4cc9-b223-51d57e41b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e75fcc4-800d-4cc9-b223-51d57e41b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0af1e8-f55a-4ae0-b9ed-733cccf5e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Volume 03e54dc3-8c93-4e80-a872-2197bfa082e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e54dc3-8c93-4e80-a872-2197bfa082e9', 'volume_size': 1} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1528554607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e54dc3-8c93-4e80-a872-2197bfa082e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300a2dd2b0854b7d8df961d735c2f41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:11:57Z,use_quota=True,user_id='9972bf3c710948deb480ab990e58cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Creating volume 03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:11:56 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:11:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:56 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 1073741824 Sep 25 16:11:56 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:57 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dc5cd049-3be7-464c-8098-6cd76df617a0" returned: 0 in 0.525s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "cinder-quobyte-dc5cd049-3be7-464c-8098-6cd76df617a0" released by "delete_volume" :: held 1.256s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:57 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339.725923fb-ef75-4e1b-9fe4-6598ebd9b226" returned: 0 in 0.415s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-725923fb-ef75-4e1b-9fe4-6598ebd9b226" released by "_delete_snapshot" :: held 2.733s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Created reservations ['7a3e9cba-6873-4852-ae0e-9b3234958b3f', '37781e34-4495-45f4-9221-0f8b4a06fcf9', '785e3915-d0f0-45f6-86e9-1e0a786ae1fb', 'c3187e7a-d565-4b15-9b68-a0aca88345a1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ba5ffe02-1f5a-41ca-9906-f8640ab75339" released by "delete_snapshot" :: held 2.793s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['3012abaa-22b8-43f3-8e18-b10d5e3d05be', '980f6689-48c2-475b-bfac-13f183bd9b6d', '383dd081-087b-438e-90e6-3dc2d87616e3', '5f41ae3d-a9f5-483d-b5db-793adcbbad59'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:57 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:57 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Delete snapshot completed successfully. Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dfd8fed4-6163-4516-a008-3789d44d31f1 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-725923fb-ef75-4e1b-9fe4-6598ebd9b226-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:57 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 1073741824" returned: 0 in 0.834s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:57 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:11:57 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:57 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.432s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-ba5ffe02-1f5a-41ca-9906-f8640ab75339-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Deleted volume successfully. Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-ba5ffe02-1f5a-41ca-9906-f8640ab75339-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-83d04168-0972-437e-bc8e-2a23fda383f9 tempest-AttachVolumeShelveTestJSON-1505967025 None] Lock "cinder-dc5cd049-3be7-464c-8098-6cd76df617a0-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-ba5ffe02-1f5a-41ca-9906-f8640ab75339" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ba5ffe02-1f5a-41ca-9906-f8640ab75339" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa9b43a-52b0-454a-b659-48e7d2711459]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:58 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.465s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0af1e8-f55a-4ae0-b9ed-733cccf5e06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e54dc3-8c93-4e80-a872-2197bfa082e9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71cf0a1-bba3-4557-8218-d5be32c909ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:11:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Volume volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 (03e54dc3-8c93-4e80-a872-2197bfa082e9): created successfully Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71cf0a1-bba3-4557-8218-d5be32c909ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Flow 'volume_create_manager' (665e06a8-0b83-4443-9c57-568d7039162e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:11:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-560d4882-f7b5-4ea2-8a5c-8c575b2d9570 tempest-VolumesActionsTest-2028058408 None] Created volume successfully. Sep 25 16:11:58 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 Sep 25 16:11:58 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:58 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339" returned: 0 in 0.606s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:58 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339 Sep 25 16:11:58 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:59 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ba5ffe02-1f5a-41ca-9906-f8640ab75339" returned: 0 in 0.413s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-ba5ffe02-1f5a-41ca-9906-f8640ab75339" released by "delete_volume" :: held 1.143s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['1fd845dc-511d-40af-9059-3fd3c8527711', 'eb72610a-01fa-4ec9-b64a-7b78ac61316f', '49bc67a9-8827-49b3-bc9d-9c958b3b123e', '21877d3b-288a-4446-9c3f-59955b1752b6'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:11:59 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:11:59 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:11:59 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.499s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:11:59 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:11:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Deleted volume successfully. Sep 25 16:12:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf254c1b-7879-4a92-a8e1-d26320d286eb tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-ba5ffe02-1f5a-41ca-9906-f8640ab75339-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-46e6f052-f620-47bb-8cb0-ace2fc29ec81-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-46e6f052-f620-47bb-8cb0-ace2fc29ec81-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "cinder-quobyte-46e6f052-f620-47bb-8cb0-ace2fc29ec81" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-46e6f052-f620-47bb-8cb0-ace2fc29ec81" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfbed61-05dc-4af5-a21d-2f73d2facd50]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:00 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 Sep 25 16:12:00 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:01 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81" returned: 0 in 0.696s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:01 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81 Sep 25 16:12:01 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:01 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-46e6f052-f620-47bb-8cb0-ace2fc29ec81" returned: 0 in 0.502s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-quobyte-46e6f052-f620-47bb-8cb0-ace2fc29ec81" released by "delete_volume" :: held 1.313s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:01 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Created reservations ['6a527809-de95-4ab9-a8bb-09ee57082e5b', '79246bb1-6b0e-471a-939b-6704dc7bec91', '1fd81fcb-639b-410e-8668-2c5cf14db0cc', 'dcfb004c-98e4-49f0-b5c6-189752c04ff2'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:02 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:12:02 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:02 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.422s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:02 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Deleted volume successfully. Sep 25 16:12:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b99eb2c6-feb6-47e9-bca0-88e54e8d3611 tempest-VolumesSnapshotTestJSON-906571138 None] Lock "cinder-46e6f052-f620-47bb-8cb0-ace2fc29ec81-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:12 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=41,cinder:INSERT=13,cinder:SELECT=30 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:12 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=28,cinder:UPDATE=45,cinder:DELETE=6,cinder:INSERT=9 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:15 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:12:15 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:15 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.404s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:12:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:12:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33e2002b-5523-491d-b46a-576d1d991c7b tempest-VolumesActionsTest-2028058408 None] Acquiring lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9" by "attach_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33e2002b-5523-491d-b46a-576d1d991c7b tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9" acquired by "attach_volume" :: waited 0.069s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-33e2002b-5523-491d-b46a-576d1d991c7b tempest-VolumesActionsTest-2028058408 None] Attaching volume 03e54dc3-8c93-4e80-a872-2197bfa082e9 to instance 33678712-1ab8-4ce4-9759-57a55a8f83ee at mountpoint /dev/vdb on host None. Sep 25 16:12:19 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-33e2002b-5523-491d-b46a-576d1d991c7b tempest-VolumesActionsTest-2028058408 None] Attach volume completed successfully. Sep 25 16:12:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-33e2002b-5523-491d-b46a-576d1d991c7b tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9" released by "attach_volume" :: held 0.427s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c37345a1-117f-4ea1-a93c-35c908cafaf6 tempest-VolumesActionsTest-2028058408 None] Acquiring lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-detach_volume" by "detach_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c37345a1-117f-4ea1-a93c-35c908cafaf6 tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:19 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c37345a1-117f-4ea1-a93c-35c908cafaf6 tempest-VolumesActionsTest-2028058408 None] Detaching volume 03e54dc3-8c93-4e80-a872-2197bfa082e9 from instance 33678712-1ab8-4ce4-9759-57a55a8f83ee. Sep 25 16:12:19 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c37345a1-117f-4ea1-a93c-35c908cafaf6 tempest-VolumesActionsTest-2028058408 None] Detach volume completed successfully. Sep 25 16:12:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c37345a1-117f-4ea1-a93c-35c908cafaf6 tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-detach_volume" released by "detach_volume" :: held 0.283s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Flow 'volume_create_manager' (c1f55c39-8c52-46fe-90ac-4c9221143e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6ab57b-1696-43b7-a97a-51b6d56dad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6ab57b-1696-43b7-a97a-51b6d56dad0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1320889320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b036d68-bdcf-4c8d-8b25-f67b8bf51750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ffd7cc76324aacb0dc4713a2bdc292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:23Z,use_quota=True,user_id='422af2b6e5ae4fa7ae227b5e5b30e610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f01f212-374c-4a2a-99f2-a453a760d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f01f212-374c-4a2a-99f2-a453a760d327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9ce79f-d5bd-44d1-a075-76a1b92a975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9ce79f-d5bd-44d1-a075-76a1b92a975e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b036d68-bdcf-4c8d-8b25-f67b8bf51750', 'volume_name': 'volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d099fd-dde1-46d7-9094-8aa6f1b1d0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d099fd-dde1-46d7-9094-8aa6f1b1d0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e15172-81b0-4248-bf9a-4d3b1de1941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:23 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750', 'volume_size': 1} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1320889320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b036d68-bdcf-4c8d-8b25-f67b8bf51750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ffd7cc76324aacb0dc4713a2bdc292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:23Z,use_quota=True,user_id='422af2b6e5ae4fa7ae227b5e5b30e610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Creating volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:23 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:12:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:23 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 1073741824 Sep 25 16:12:23 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:24 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 1073741824" returned: 0 in 1.284s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:24 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 Sep 25 16:12:24 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:25 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" returned: 0 in 0.348s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e15172-81b0-4248-bf9a-4d3b1de1941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908b4ba0-b4f0-4737-97f8-f6b5557d9cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Volume volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 (9b036d68-bdcf-4c8d-8b25-f67b8bf51750): created successfully Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908b4ba0-b4f0-4737-97f8-f6b5557d9cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Flow 'volume_create_manager' (c1f55c39-8c52-46fe-90ac-4c9221143e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b67917ba-9156-4f7a-a037-6accd8ef87ac tempest-VolumesSnapshotListTestJSON-1294802874 None] Created volume successfully. Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Creating offline snapshot 0565bb3f-3c6b-43de-9f41-2815902b2182 of volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:12:26 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b26ae3d-89a5-4a12-9328-b777077c4a79]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:26 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 Sep 25 16:12:26 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:26 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" returned: 0 in 0.815s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:26 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 1G Sep 25 16:12:26 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:27 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 1G" returned: 0 in 0.781s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:27 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 Sep 25 16:12:27 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:28 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182" returned: 0 in 0.584s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:28 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 is being set with open permissions: ugo+rw Sep 25 16:12:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:28 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 Sep 25 16:12:28 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:28 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182" returned: 0 in 0.757s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:29 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.info Sep 25 16:12:29 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:29 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.info" returned: 0 in 0.494s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:29 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.info is being set with open permissions: ugo+rw Sep 25 16:12:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:29 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.info Sep 25 16:12:29 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:30 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.info" returned: 0 in 0.629s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.312s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f1994590-a305-4ac2-8dd7-7d76820116cd tempest-VolumesSnapshotListTestJSON-1294802874 None] Create snapshot completed successfully Sep 25 16:12:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Creating offline snapshot 099f09d5-d389-42c7-8863-5bf0f2e5f39d of volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:12:31 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6892a9e1-d21b-440b-82fd-2391d1c803a0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:32 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 Sep 25 16:12:32 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:32 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182" returned: 0 in 0.765s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:12:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:32 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d 1G Sep 25 16:12:32 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:33 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d 1G" returned: 0 in 0.898s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:33 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d Sep 25 16:12:33 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:34 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d" returned: 0 in 0.621s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:34 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d is being set with open permissions: ugo+rw Sep 25 16:12:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:34 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d Sep 25 16:12:34 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:34 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d" returned: 0 in 0.493s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.962s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7e06534a-160c-4dce-8eec-dfd29d0d6a14 tempest-VolumesSnapshotListTestJSON-1294802874 None] Create snapshot completed successfully Sep 25 16:12:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Creating offline snapshot 6256826e-5c0a-4f02-bde2-c54093d1b5b5 of volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:12:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[051b1a84-32f9-4ab5-be3f-06fb209a4ae0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:35 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d Sep 25 16:12:35 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:36 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d" returned: 0 in 0.918s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:12:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:36 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 1G Sep 25 16:12:36 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:37 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 1G" returned: 0 in 1.165s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:37 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 Sep 25 16:12:37 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:38 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5" returned: 0 in 0.823s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:38 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 is being set with open permissions: ugo+rw Sep 25 16:12:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:38 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 Sep 25 16:12:38 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:39 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5" returned: 0 in 0.662s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.852s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-88d8cb31-3bcb-4313-9fde-3043f80da68d tempest-VolumesSnapshotListTestJSON-1294802874 None] Create snapshot completed successfully Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-6256826e-5c0a-4f02-bde2-c54093d1b5b5-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-6256826e-5c0a-4f02-bde2-c54093d1b5b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-quobyte-6256826e-5c0a-4f02-bde2-c54093d1b5b5" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-6256826e-5c0a-4f02-bde2-c54093d1b5b5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Deleting offline snapshot 6256826e-5c0a-4f02-bde2-c54093d1b5b5 of volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] snapshot_file for this snap is: volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a5144-4bb8-4b87-9927-9db7241229f5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:41 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 Sep 25 16:12:41 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:42 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5" returned: 0 in 0.837s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:12:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8576d386-b5ea-4a8d-9ed0-a3046938cd5b tempest-VolumesActionsTest-2028058408 None] Acquiring lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9" by "attach_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd9d8b0-0c5c-47ef-a85b-904da9a2392a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8576d386-b5ea-4a8d-9ed0-a3046938cd5b tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9" acquired by "attach_volume" :: waited 0.064s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8576d386-b5ea-4a8d-9ed0-a3046938cd5b tempest-VolumesActionsTest-2028058408 None] Attaching volume 03e54dc3-8c93-4e80-a872-2197bfa082e9 to instance b594d140-d7ee-4d89-ae80-41b630d1a48c at mountpoint /dev/vdb on host None. Sep 25 16:12:42 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d Sep 25 16:12:42 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8576d386-b5ea-4a8d-9ed0-a3046938cd5b tempest-VolumesActionsTest-2028058408 None] Attach volume completed successfully. Sep 25 16:12:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8576d386-b5ea-4a8d-9ed0-a3046938cd5b tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9" released by "attach_volume" :: held 0.206s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:43 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d" returned: 0 in 0.935s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:12:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:43 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 Sep 25 16:12:43 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7636ec77-ad8b-47c6-896c-5c85795745dd tempest-VolumesActionsTest-2028058408 None] Acquiring lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-detach_volume" by "detach_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7636ec77-ad8b-47c6-896c-5c85795745dd tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7636ec77-ad8b-47c6-896c-5c85795745dd tempest-VolumesActionsTest-2028058408 None] Detaching volume 03e54dc3-8c93-4e80-a872-2197bfa082e9 from instance b594d140-d7ee-4d89-ae80-41b630d1a48c. Sep 25 16:12:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7636ec77-ad8b-47c6-896c-5c85795745dd tempest-VolumesActionsTest-2028058408 None] Detach volume completed successfully. Sep 25 16:12:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7636ec77-ad8b-47c6-896c-5c85795745dd tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:44 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5" returned: 0 in 1.034s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:44 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5 Sep 25 16:12:44 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:45 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.6256826e-5c0a-4f02-bde2-c54093d1b5b5" returned: 0 in 0.592s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-6256826e-5c0a-4f02-bde2-c54093d1b5b5" released by "_delete_snapshot" :: held 3.674s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" released by "delete_snapshot" :: held 3.728s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Created reservations ['a29d897a-52cd-4976-a9a4-f6e0f392bdd2', '1692554d-b21c-49c0-8fa7-a2597e17499f', '12267868-505e-4af5-a18d-3b7ba9177aaa', 'da94200e-f9b7-4ad9-bef0-2fd56c4a6c50'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:45 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Delete snapshot completed successfully. Sep 25 16:12:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c46251fa-86a3-4d90-aed4-1f8b192fd660 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-6256826e-5c0a-4f02-bde2-c54093d1b5b5-delete_snapshot" released by "delete_snapshot" :: held 3.974s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-099f09d5-d389-42c7-8863-5bf0f2e5f39d-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-099f09d5-d389-42c7-8863-5bf0f2e5f39d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-quobyte-099f09d5-d389-42c7-8863-5bf0f2e5f39d" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-099f09d5-d389-42c7-8863-5bf0f2e5f39d" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Deleting offline snapshot 099f09d5-d389-42c7-8863-5bf0f2e5f39d of volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] snapshot_file for this snap is: volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a280a6-3b84-44e2-ab41-b73bf73609f7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:46 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d Sep 25 16:12:46 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:46 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d" returned: 0 in 0.672s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb104f2-75c9-4e69-a938-a442e054fb13]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:47 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 Sep 25 16:12:47 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:47 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182" returned: 0 in 0.517s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:12:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:47 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d Sep 25 16:12:47 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:48 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d" returned: 0 in 0.605s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:48 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d Sep 25 16:12:48 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:48 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.099f09d5-d389-42c7-8863-5bf0f2e5f39d" returned: 0 in 0.361s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-099f09d5-d389-42c7-8863-5bf0f2e5f39d" released by "_delete_snapshot" :: held 2.353s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" released by "delete_snapshot" :: held 2.425s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:48 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Created reservations ['bd33fa11-a7b0-4353-acbd-04b9544e00a0', 'aa53af61-01d4-4686-b246-93283e3a450e', '4872915c-d6c4-482c-8770-870ab1bf2fdb', 'b13b89e8-fe91-4e2a-aa89-9531a3b15250'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Delete snapshot completed successfully. Sep 25 16:12:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a271102-75a4-4798-908c-c5d438f0fdb4 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-099f09d5-d389-42c7-8863-5bf0f2e5f39d-delete_snapshot" released by "delete_snapshot" :: held 2.726s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-0565bb3f-3c6b-43de-9f41-2815902b2182-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-0565bb3f-3c6b-43de-9f41-2815902b2182-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-quobyte-0565bb3f-3c6b-43de-9f41-2815902b2182" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-0565bb3f-3c6b-43de-9f41-2815902b2182" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Deleting offline snapshot 0565bb3f-3c6b-43de-9f41-2815902b2182 of volume 9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] snapshot_file for this snap is: volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e55d788-afab-4c1e-bbf9-cf7831b25d5d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:49 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 Sep 25 16:12:49 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:50 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182" returned: 0 in 0.859s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[695c4891-0ec4-4b74-aecc-84baab18bdda]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Flow 'volume_create_manager' (5671e880-bcb0-4ad7-ae22-0b9b2acbf25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a226aad4-96d1-472f-82f2-dc4c94ca6eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a226aad4-96d1-472f-82f2-dc4c94ca6eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1326993619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5de80a6-56aa-45e2-919c-70dce323edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f4e6af9ef44805a8b75645684ce791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:51Z,use_quota=True,user_id='046fe45aa0a245129074601fcab98665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:50 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 Sep 25 16:12:50 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7a7185-08b0-4033-9c87-e688cd2c2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7a7185-08b0-4033-9c87-e688cd2c2da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565c8c7b-d37e-4f9a-a083-263171197918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565c8c7b-d37e-4f9a-a083-263171197918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5de80a6-56aa-45e2-919c-70dce323edcf', 'volume_name': 'volume-c5de80a6-56aa-45e2-919c-70dce323edcf', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d073ea7-6048-4e8a-a73d-5310511f28ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d073ea7-6048-4e8a-a73d-5310511f28ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2ea63c-aec4-4e51-b8a8-cef9b268fe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Volume c5de80a6-56aa-45e2-919c-70dce323edcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5de80a6-56aa-45e2-919c-70dce323edcf', 'volume_size': 1} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1326993619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5de80a6-56aa-45e2-919c-70dce323edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f4e6af9ef44805a8b75645684ce791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:12:51Z,use_quota=True,user_id='046fe45aa0a245129074601fcab98665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Creating volume c5de80a6-56aa-45e2-919c-70dce323edcf {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:12:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:12:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:50 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf 1073741824 Sep 25 16:12:50 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:51 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" returned: 0 in 0.753s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:51 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 Sep 25 16:12:51 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:51 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182" returned: 0 in 0.646s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:51 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf 1073741824" returned: 0 in 0.957s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:51 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182 Sep 25 16:12:51 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:51 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf Sep 25 16:12:51 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:52 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750.0565bb3f-3c6b-43de-9f41-2815902b2182" returned: 0 in 0.406s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:52 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf" returned: 0 in 0.345s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.462s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-0565bb3f-3c6b-43de-9f41-2815902b2182" released by "_delete_snapshot" :: held 2.909s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2ea63c-aec4-4e51-b8a8-cef9b268fe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5de80a6-56aa-45e2-919c-70dce323edcf', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6943b3a5-da9d-4f80-8cef-7653e3e89c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec0c1e5-438c-4ac3-b4da-d69202b74c4c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" released by "delete_snapshot" :: held 2.979s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Volume volume-c5de80a6-56aa-45e2-919c-70dce323edcf (c5de80a6-56aa-45e2-919c-70dce323edcf): created successfully Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6943b3a5-da9d-4f80-8cef-7653e3e89c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Flow 'volume_create_manager' (5671e880-bcb0-4ad7-ae22-0b9b2acbf25e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:12:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-16399fef-9a51-47ca-a17d-e4fd72f2856a tempest-AttachVolumeTestJSON-1132387730 None] Created volume successfully. Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Created reservations ['2ee50565-4510-472f-8fd0-77025fedc431', '7562dfe8-ef30-400f-a72e-8256f45584bc', 'fd834f4d-b010-4cff-af30-fd400540b099', '0a699406-a665-43b2-b9d8-467620acd79f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:52 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:12:52 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Delete snapshot completed successfully. Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fd6d450f-a732-4bbb-8dd9-133704723ae5 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-0565bb3f-3c6b-43de-9f41-2815902b2182-delete_snapshot" released by "delete_snapshot" :: held 3.307s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:52 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.632s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:53 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae6c16-0592-4df5-b5df-d616065996f0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:53 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:12:53 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:53 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.689s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.0bee3420-5148-4db6-8c97-cf07a754f0e3hyd0wquo.img {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:53 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.0bee3420-5148-4db6-8c97-cf07a754f0e3hyd0wquo.img Sep 25 16:12:53 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-9b036d68-bdcf-4c8d-8b25-f67b8bf51750-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-9b036d68-bdcf-4c8d-8b25-f67b8bf51750-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:12:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:12:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d008c44-30b6-4791-92c2-f0e65a87a6ac]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:12:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:54 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 Sep 25 16:12:54 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-0f5a0675-6037-4dff-a968-cba98c9ebe29 req-bccca9c3-4341-46e2-af69-167d8c6da28d tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:55 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" returned: 0 in 1.082s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:55 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750 Sep 25 16:12:55 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:56 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" returned: 0 in 0.938s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-quobyte-9b036d68-bdcf-4c8d-8b25-f67b8bf51750" released by "delete_volume" :: held 2.186s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Created reservations ['6a0f1fe6-07a0-4283-80f2-ba287f34528a', '240f451a-ae8b-4bd5-832e-d27924c948e5', 'dbbd3318-3ecd-4f18-bf66-f98ea8f140dd', 'bae3c051-81f8-43de-8dfe-5f16ac36a447'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:12:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:12:56 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:12:56 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:12:57 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 25 16:12:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.690s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:12:57 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:12:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Deleted volume successfully. Sep 25 16:12:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d3e42e1-b994-45f0-8bfc-5d6633799966 tempest-VolumesSnapshotListTestJSON-1294802874 None] Lock "cinder-9b036d68-bdcf-4c8d-8b25-f67b8bf51750-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:05 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.0bee3420-5148-4db6-8c97-cf07a754f0e3hyd0wquo.img" returned: 0 in 11.654s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:05 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cf52d9-bd63-40ed-b849-0b908b9cd9dd]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:05 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:13:05 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:06 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.763s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:06 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9, size 1024.00 MB, duration 11.66 sec, destination /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.0bee3420-5148-4db6-8c97-cf07a754f0e3hyd0wquo.img {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:13:06 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Converted 1024.00 MB image at 87.86 MB/s Sep 25 16:13:06 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] 0bee3420-5148-4db6-8c97-cf07a754f0e3 was raw, no need to convert to raw {{(pid=87467) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1183}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=49,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=5 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Flow 'volume_create_manager' (e00ca294-3966-4d7f-b283-c20cf7e8c97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19723f3a-f784-4bc7-b7d9-7ff2229964d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19723f3a-f784-4bc7-b7d9-7ff2229964d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1357992215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb522ef9-35e8-4fae-a445-333dd75e791e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b8520517324c9fa6c074c8effb88f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:08Z,use_quota=True,user_id='0e2e111caff04f429d3615bfab002021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627c4d33-5f1a-4d60-96e3-3e9841951e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627c4d33-5f1a-4d60-96e3-3e9841951e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6f1c80-63ba-4c30-a0f3-022c3d21c300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6f1c80-63ba-4c30-a0f3-022c3d21c300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb522ef9-35e8-4fae-a445-333dd75e791e', 'volume_name': 'volume-eb522ef9-35e8-4fae-a445-333dd75e791e', 'volume_size': 2}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a85d412-0c8c-4bfe-b712-7f0679ac5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a85d412-0c8c-4bfe-b712-7f0679ac5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb0334d-f2e5-4c8f-be49-c85f24e5396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:07 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Volume eb522ef9-35e8-4fae-a445-333dd75e791e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb522ef9-35e8-4fae-a445-333dd75e791e', 'volume_size': 2} Sep 25 16:13:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:15 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:13:15 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:15 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.316s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:13:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:13:17 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:17 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:INSERT=14,cinder:UPDATE=40,cinder:SELECT=48,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:25 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Flow 'volume_create_manager' (9adc1241-7e81-4118-a889-4b0fe81e8c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52ce671-782a-4bf8-ac8d-6b924b3c38a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52ce671-782a-4bf8-ac8d-6b924b3c38a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1576299742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30157b4c-518e-45c7-bdde-d9d04f7af581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c759148302e454fa13a5b8009906ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:26Z,use_quota=True,user_id='7ca41a04be15467baf52177421a20d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fded13-e6b3-422e-b968-5c941dee4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fded13-e6b3-422e-b968-5c941dee4c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b293cf-b087-4d4e-8a65-8b7d293c07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b293cf-b087-4d4e-8a65-8b7d293c07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30157b4c-518e-45c7-bdde-d9d04f7af581', 'volume_name': 'volume-30157b4c-518e-45c7-bdde-d9d04f7af581', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995586d4-08e8-4790-a76a-951584b36958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995586d4-08e8-4790-a76a-951584b36958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ac5346-a5d7-45ce-be1c-45aae35293ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:26 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Volume 30157b4c-518e-45c7-bdde-d9d04f7af581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30157b4c-518e-45c7-bdde-d9d04f7af581', 'volume_size': 1} Sep 25 16:13:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.100s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Uploaded volume to glance image-id: 0bee3420-5148-4db6-8c97-cf07a754f0e3. {{(pid=87467) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-0f5a0675-6037-4dff-a968-cba98c9ebe29 req-bccca9c3-4341-46e2-af69-167d8c6da28d tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 34.089s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4a9172a2-9e1e-44e1-bc2f-f4823e04c163 tempest-VolumesActionsTest-2028058408 None] Copy volume to image completed successfully. Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-0f5a0675-6037-4dff-a968-cba98c9ebe29 req-bccca9c3-4341-46e2-af69-167d8c6da28d tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.762s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1357992215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb522ef9-35e8-4fae-a445-333dd75e791e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b8520517324c9fa6c074c8effb88f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:08Z,use_quota=True,user_id='0e2e111caff04f429d3615bfab002021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Creating volume eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:28 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e 2147483648 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:28 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e 2147483648 Sep 25 16:13:28 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-0f5a0675-6037-4dff-a968-cba98c9ebe29 req-bccca9c3-4341-46e2-af69-167d8c6da28d tempest-AttachVolumeTestJSON-1132387730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-c5de80a6-56aa-45e2-919c-70dce323edcf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4d0220d-ada6-4143-a2b0-550c9f1bb117', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:13:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-0f5a0675-6037-4dff-a968-cba98c9ebe29 req-bccca9c3-4341-46e2-af69-167d8c6da28d tempest-AttachVolumeTestJSON-1132387730 None] attachment_update completed successfully. Sep 25 16:13:29 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e 2147483648" returned: 0 in 0.774s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:29 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e Sep 25 16:13:29 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:29 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.647s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1576299742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30157b4c-518e-45c7-bdde-d9d04f7af581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c759148302e454fa13a5b8009906ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:13:26Z,use_quota=True,user_id='7ca41a04be15467baf52177421a20d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Creating volume 30157b4c-518e-45c7-bdde-d9d04f7af581 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:13:29 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb0334d-f2e5-4c8f-be49-c85f24e5396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb522ef9-35e8-4fae-a445-333dd75e791e', 'volume_size': 2}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:29 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 1073741824 Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd860aa-2628-4d1d-a779-926c8b90bc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:29 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:29 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Volume volume-eb522ef9-35e8-4fae-a445-333dd75e791e (eb522ef9-35e8-4fae-a445-333dd75e791e): created successfully Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd860aa-2628-4d1d-a779-926c8b90bc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Flow 'volume_create_manager' (e00ca294-3966-4d7f-b283-c20cf7e8c97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-109b898a-893c-463f-8457-ce2880b6f5e7 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Created volume successfully. Sep 25 16:13:30 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 1073741824" returned: 0 in 0.656s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:30 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 Sep 25 16:13:30 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:30 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581" returned: 0 in 0.402s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.345s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ac5346-a5d7-45ce-be1c-45aae35293ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30157b4c-518e-45c7-bdde-d9d04f7af581', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b16b959-fe6a-4440-9573-c4dce8c7b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8de6c2-74f3-44c2-b59c-e26d16490ab0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:30 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Volume volume-30157b4c-518e-45c7-bdde-d9d04f7af581 (30157b4c-518e-45c7-bdde-d9d04f7af581): created successfully Sep 25 16:13:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b16b959-fe6a-4440-9573-c4dce8c7b86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:13:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Flow 'volume_create_manager' (9adc1241-7e81-4118-a889-4b0fe81e8c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:13:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c2a0c6dd-63aa-4adb-9589-f465c888fef1 tempest-AttachVolumeNegativeTest-1878192140 None] Created volume successfully. Sep 25 16:13:31 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:13:31 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:31 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.518s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:31 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d0b6b-a0b2-48e5-888b-0f4aaa9de711]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:31 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:13:31 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:32 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.539s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:32 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img Sep 25 16:13:32 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-cc1d12ee-9858-4eff-88d0-db76925935a3 req-fd1d6c04-38d4-490c-b552-532486a25522 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:42 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img" returned: 0 in 10.038s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[327dd99b-255c-4ed5-bfa3-04145a0fcea1]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:42 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:13:42 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=6,cinder:SELECT=13,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=10,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:13:42 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.738s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:13:42 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Converted 1024.00 MB image at 102.00 MB/s Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] cb6a2823-cbf7-49d2-9670-83228467cf14 was raw, converting to qcow2 {{(pid=87467) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1200}} Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[932090d0-1343-46e4-8b67-1fa9b3d00f2c]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:42 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img Sep 25 16:13:42 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:43 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img" returned: 0 in 0.400s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:43 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img Sep 25 16:13:43 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:43 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img" returned: 1 in 0.480s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:13:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img /opt/stack/data/cinder/conversion/vol_upload_k2cjnurk {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:43 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img /opt/stack/data/cinder/conversion/vol_upload_k2cjnurk Sep 25 16:13:43 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:44 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img /opt/stack/data/cinder/conversion/vol_upload_k2cjnurk" returned: 0 in 0.418s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:44 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Image conversion details: src /opt/stack/data/cinder/conversion/03e54dc3-8c93-4e80-a872-2197bfa082e9.temp_image.cb6a2823-cbf7-49d2-9670-83228467cf14w0e_vzt7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_k2cjnurk {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:13:44 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 16:13:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a29e20-b22b-455c-bb4d-7abcd4719416]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k2cjnurk {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:44 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k2cjnurk Sep 25 16:13:44 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:44 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k2cjnurk" returned: 0 in 0.373s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.566s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Uploaded volume to glance image-id: cb6a2823-cbf7-49d2-9670-83228467cf14. {{(pid=87467) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.408s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Creating offline snapshot 70a40656-8e09-41fe-82da-085d93a5f902 of volume eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:13:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ca947b5f-b162-4df5-ac52-dbb25fe769cf tempest-VolumesActionsTest-2028058408 None] Copy volume to image completed successfully. Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a5cf17-0e27-4cc5-91ee-0926997b11e3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:46 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e Sep 25 16:13:46 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:46 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e" returned: 0 in 0.441s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 2G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:46 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 2G Sep 25 16:13:46 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:47 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 2G" returned: 0 in 0.566s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb522ef9-35e8-4fae-a445-333dd75e791e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:47 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb522ef9-35e8-4fae-a445-333dd75e791e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 Sep 25 16:13:47 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Acquiring lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Acquiring lock "cinder-quobyte-03e54dc3-8c93-4e80-a872-2197bfa082e9" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Lock "cinder-quobyte-03e54dc3-8c93-4e80-a872-2197bfa082e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beab42c-86fd-4707-b395-88c27a4f12fd]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:47 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb522ef9-35e8-4fae-a445-333dd75e791e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:47 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 is being set with open permissions: ugo+rw Sep 25 16:13:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:47 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:13:47 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:47 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 Sep 25 16:13:47 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:48 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.497s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:48 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:48 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9 Sep 25 16:13:48 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:48 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.info Sep 25 16:13:48 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:48 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03e54dc3-8c93-4e80-a872-2197bfa082e9" returned: 0 in 0.312s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Lock "cinder-quobyte-03e54dc3-8c93-4e80-a872-2197bfa082e9" released by "delete_volume" :: held 0.859s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Created reservations ['ca39b2df-0a76-4e2c-b380-eef2b37892e3', 'c7edd8c7-88e6-4e33-b308-535188540935', 'd21c891a-3c07-4ab9-b21a-34a9b3212a31', 'a269acce-7a07-4e64-bd2c-95e48e1890da'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:48 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.info" returned: 0 in 0.392s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:48 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.info is being set with open permissions: ugo+rw Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:48 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.info Sep 25 16:13:48 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:48 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:13:48 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:49 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.info" returned: 0 in 0.344s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:49 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.708s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-cc1d12ee-9858-4eff-88d0-db76925935a3 req-fd1d6c04-38d4-490c-b552-532486a25522 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.779s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.331s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Deleted volume successfully. Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-cc1d12ee-9858-4eff-88d0-db76925935a3 req-fd1d6c04-38d4-490c-b552-532486a25522 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.090s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a1801fab-317a-4c79-b3ac-ee61fe38013d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Create snapshot completed successfully Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-cc1d12ee-9858-4eff-88d0-db76925935a3 req-fd1d6c04-38d4-490c-b552-532486a25522 tempest-AttachVolumeNegativeTest-1878192140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-30157b4c-518e-45c7-bdde-d9d04f7af581', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf2ee355-edc4-4be3-b8fa-f393fa7703ed', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c4b2eb66-b1cb-4388-a285-ff5f780152a6 tempest-VolumesActionsTest-2028058408 None] Lock "cinder-03e54dc3-8c93-4e80-a872-2197bfa082e9-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-cc1d12ee-9858-4eff-88d0-db76925935a3 req-fd1d6c04-38d4-490c-b552-532486a25522 tempest-AttachVolumeNegativeTest-1878192140 None] attachment_update completed successfully. Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "cinder-70a40656-8e09-41fe-82da-085d93a5f902-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-70a40656-8e09-41fe-82da-085d93a5f902-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "cinder-quobyte-eb522ef9-35e8-4fae-a445-333dd75e791e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-quobyte-eb522ef9-35e8-4fae-a445-333dd75e791e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "cinder-quobyte-70a40656-8e09-41fe-82da-085d93a5f902" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-quobyte-70a40656-8e09-41fe-82da-085d93a5f902" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Deleting offline snapshot 70a40656-8e09-41fe-82da-085d93a5f902 of volume eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] snapshot_file for this snap is: volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc1f916-c288-4c75-b900-9662bf3f5ad1]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:49 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 Sep 25 16:13:49 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:50 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902" returned: 0 in 0.587s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb522ef9-35e8-4fae-a445-333dd75e791e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:13:50 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b55d557-1a73-4d69-824d-d43c111a2082]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:50 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e Sep 25 16:13:50 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:51 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e" returned: 0 in 0.595s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:51 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 Sep 25 16:13:51 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:51 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902" returned: 0 in 0.446s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:51 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902 Sep 25 16:13:51 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:51 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e.70a40656-8e09-41fe-82da-085d93a5f902" returned: 0 in 0.409s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-quobyte-70a40656-8e09-41fe-82da-085d93a5f902" released by "_delete_snapshot" :: held 2.222s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-quobyte-eb522ef9-35e8-4fae-a445-333dd75e791e" released by "delete_snapshot" :: held 2.268s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:52 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Created reservations ['83186e46-00d3-4293-9c17-6314db0b670a', 'cd79e76e-97da-4e59-b997-c858927e727e', 'e69d607a-6938-4971-8392-0807175cfa37', '24d622c5-1f0a-4106-a82e-20f586ddf510'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Delete snapshot completed successfully. Sep 25 16:13:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4b92d213-942f-4033-aebb-591ac7982336 tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-70a40656-8e09-41fe-82da-085d93a5f902-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "cinder-eb522ef9-35e8-4fae-a445-333dd75e791e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-eb522ef9-35e8-4fae-a445-333dd75e791e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "cinder-quobyte-eb522ef9-35e8-4fae-a445-333dd75e791e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:13:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-quobyte-eb522ef9-35e8-4fae-a445-333dd75e791e" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:13:53 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c55e1b-9123-4af1-8864-9ca3f1a0dccb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:13:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:53 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e Sep 25 16:13:53 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:54 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e" returned: 0 in 0.820s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:54 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e Sep 25 16:13:54 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:55 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb522ef9-35e8-4fae-a445-333dd75e791e" returned: 0 in 0.652s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-quobyte-eb522ef9-35e8-4fae-a445-333dd75e791e" released by "delete_volume" :: held 1.762s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Created reservations ['03d6a4b4-5d3f-476a-8bfc-6d86936c2c08', 'e643a448-ce70-458e-aeeb-16a4da309a2a', '37cd4d3a-a509-4d4e-bace-97223fb10362', '9fb06f4f-eabb-45ac-913a-3a8f98a3b6ca'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:13:55 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:13:55 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:13:55 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.489s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:13:55 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:13:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Deleted volume successfully. Sep 25 16:13:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3e8bcc9c-6f24-4dbb-af12-f64d41760d2d tempest-VolumesSnapshotNegativeTestJSON-1125548009 None] Lock "cinder-eb522ef9-35e8-4fae-a445-333dd75e791e-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Flow 'volume_create_manager' (5b95ceea-0e8a-4c3a-92a9-3ead1f1d7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc5faa7-a982-44dd-8592-9b8f2994de01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc5faa7-a982-44dd-8592-9b8f2994de01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1167509039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b380ec-c191-4ecc-8aa9-500a9d9e2cdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='779d103f0b224085a10fb96023c369a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:02Z,use_quota=True,user_id='55bab5e029094417a4b254762d9e4347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e92a5f-07db-48d4-83a7-805d5712c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e92a5f-07db-48d4-83a7-805d5712c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e3982-8496-42f2-9631-2cd94a180456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e3982-8496-42f2-9631-2cd94a180456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b380ec-c191-4ecc-8aa9-500a9d9e2cdd', 'volume_name': 'volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc7a504-5340-407b-8401-72c33619dc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc7a504-5340-407b-8401-72c33619dc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279dccf9-f0af-414d-b504-7dbeeb2d01d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:02 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Volume 18b380ec-c191-4ecc-8aa9-500a9d9e2cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd', 'volume_size': 1} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1167509039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b380ec-c191-4ecc-8aa9-500a9d9e2cdd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='779d103f0b224085a10fb96023c369a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:02Z,use_quota=True,user_id='55bab5e029094417a4b254762d9e4347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Creating volume 18b380ec-c191-4ecc-8aa9-500a9d9e2cdd {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:02 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:14:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:02 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd 1073741824 Sep 25 16:14:02 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:03 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd 1073741824" returned: 0 in 0.783s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:03 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd Sep 25 16:14:03 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:03 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd" returned: 0 in 0.406s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279dccf9-f0af-414d-b504-7dbeeb2d01d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dbf8a9-9a1d-4f76-9c03-bee710aed551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:03 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Volume volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd (18b380ec-c191-4ecc-8aa9-500a9d9e2cdd): created successfully Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dbf8a9-9a1d-4f76-9c03-bee710aed551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Flow 'volume_create_manager' (5b95ceea-0e8a-4c3a-92a9-3ead1f1d7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c06df8af-d424-44fa-9d2c-f60527adc0a9 tempest-VolumesListTestJSON-835057725 None] Created volume successfully. Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Flow 'volume_create_manager' (3d2ce15a-dbaf-4084-b71e-71f925fc1e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0155d11c-d3df-4c64-9d56-c6d98c2d575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0155d11c-d3df-4c64-9d56-c6d98c2d575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-295027719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303f995c-c8b6-4c0d-9c48-4ffd13a57e50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='779d103f0b224085a10fb96023c369a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:06Z,use_quota=True,user_id='55bab5e029094417a4b254762d9e4347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758a37ef-75e8-4c7e-8f5a-9ec1492e1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758a37ef-75e8-4c7e-8f5a-9ec1492e1468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3ac80-a785-42aa-9cc5-b4927da3e088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3ac80-a785-42aa-9cc5-b4927da3e088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303f995c-c8b6-4c0d-9c48-4ffd13a57e50', 'volume_name': 'volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac7063a-0dd5-4a8d-896e-9d77299a9147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac7063a-0dd5-4a8d-896e-9d77299a9147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd68fe3-81ff-46d6-a384-048cecd8747a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:06 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Volume 303f995c-c8b6-4c0d-9c48-4ffd13a57e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50', 'volume_size': 1} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-295027719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303f995c-c8b6-4c0d-9c48-4ffd13a57e50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='779d103f0b224085a10fb96023c369a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:06Z,use_quota=True,user_id='55bab5e029094417a4b254762d9e4347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Creating volume 303f995c-c8b6-4c0d-9c48-4ffd13a57e50 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:06 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:14:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:06 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 1073741824 Sep 25 16:14:06 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:07 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 1073741824" returned: 0 in 0.860s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:07 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 Sep 25 16:14:07 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:07 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50" returned: 0 in 0.307s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd68fe3-81ff-46d6-a384-048cecd8747a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8083edf6-6d55-4a53-affc-fd5ed2593b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:07 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Volume volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 (303f995c-c8b6-4c0d-9c48-4ffd13a57e50): created successfully Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8083edf6-6d55-4a53-affc-fd5ed2593b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Flow 'volume_create_manager' (3d2ce15a-dbaf-4084-b71e-71f925fc1e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:07 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-28fa092a-aa96-485a-97f3-801ffb543396 tempest-VolumesListTestJSON-835057725 None] Created volume successfully. Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Flow 'volume_create_manager' (561a7ab5-02c5-46d8-a34c-c1100562adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3929eb3-a643-4df2-b294-837428eecc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3929eb3-a643-4df2-b294-837428eecc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1599367896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e38c49-aed1-4090-a14c-48045dbb699b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='779d103f0b224085a10fb96023c369a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:09Z,use_quota=True,user_id='55bab5e029094417a4b254762d9e4347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412fefd3-5ddd-418c-a36f-67ab39a52b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412fefd3-5ddd-418c-a36f-67ab39a52b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb850e6-f6cb-4e68-86e4-4f6ad99ab49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb850e6-f6cb-4e68-86e4-4f6ad99ab49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e38c49-aed1-4090-a14c-48045dbb699b', 'volume_name': 'volume-e0e38c49-aed1-4090-a14c-48045dbb699b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f2f633-3e3f-4fe6-ab56-01531a8a9758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f2f633-3e3f-4fe6-ab56-01531a8a9758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f86deb-ab6b-4ea0-83b9-bd0de2739ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:09 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Volume e0e38c49-aed1-4090-a14c-48045dbb699b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e38c49-aed1-4090-a14c-48045dbb699b', 'volume_size': 1} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1599367896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e38c49-aed1-4090-a14c-48045dbb699b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='779d103f0b224085a10fb96023c369a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:09Z,use_quota=True,user_id='55bab5e029094417a4b254762d9e4347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Creating volume e0e38c49-aed1-4090-a14c-48045dbb699b {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:09 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:14:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:09 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b 1073741824 Sep 25 16:14:09 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:10 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b 1073741824" returned: 0 in 0.855s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:10 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b Sep 25 16:14:10 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:11 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b" returned: 0 in 0.623s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f86deb-ab6b-4ea0-83b9-bd0de2739ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e38c49-aed1-4090-a14c-48045dbb699b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d19312f-0cdc-4451-9ea1-3718fee34d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:11 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Volume volume-e0e38c49-aed1-4090-a14c-48045dbb699b (e0e38c49-aed1-4090-a14c-48045dbb699b): created successfully Sep 25 16:14:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d19312f-0cdc-4451-9ea1-3718fee34d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Flow 'volume_create_manager' (561a7ab5-02c5-46d8-a34c-c1100562adc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-86a3a5ea-85c0-4c11-84a7-658f1e8d322f tempest-VolumesListTestJSON-835057725 None] Created volume successfully. Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:15 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:14:15 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Acquiring lock "cinder-e0e38c49-aed1-4090-a14c-48045dbb699b-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Lock "cinder-e0e38c49-aed1-4090-a14c-48045dbb699b-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Acquiring lock "cinder-quobyte-e0e38c49-aed1-4090-a14c-48045dbb699b" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Lock "cinder-quobyte-e0e38c49-aed1-4090-a14c-48045dbb699b" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:15 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.483s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fb3b00-e487-4139-9fdb-4fd10a1dff3f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:16 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b Sep 25 16:14:16 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:16 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b" returned: 0 in 0.825s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:16 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b Sep 25 16:14:16 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:17 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e0e38c49-aed1-4090-a14c-48045dbb699b" returned: 0 in 0.483s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Lock "cinder-quobyte-e0e38c49-aed1-4090-a14c-48045dbb699b" released by "delete_volume" :: held 1.423s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Created reservations ['590c27a9-41c8-4ed8-8e17-c68fe8664ca1', 'f55b5b86-730a-4a96-b5c6-bf3d28b09e17', 'c48d34f6-9003-47ed-af50-18996d28a539', '4c2800c2-75c7-4ffc-af62-9b6e948ddfda'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:17 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:14:17 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:18 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.550s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Deleted volume successfully. Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-21ac4afe-e6d9-43a7-94cb-1138ac13d56e tempest-VolumesListTestJSON-835057725 None] Lock "cinder-e0e38c49-aed1-4090-a14c-48045dbb699b-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "cinder-303f995c-c8b6-4c0d-9c48-4ffd13a57e50-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-303f995c-c8b6-4c0d-9c48-4ffd13a57e50-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "cinder-quobyte-303f995c-c8b6-4c0d-9c48-4ffd13a57e50" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-quobyte-303f995c-c8b6-4c0d-9c48-4ffd13a57e50" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e41430-95d7-4298-a4e0-c0bc2f638db9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:18 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 Sep 25 16:14:18 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:19 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50" returned: 0 in 0.491s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:19 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50 Sep 25 16:14:19 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:19 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-303f995c-c8b6-4c0d-9c48-4ffd13a57e50" returned: 0 in 0.289s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-quobyte-303f995c-c8b6-4c0d-9c48-4ffd13a57e50" released by "delete_volume" :: held 0.834s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Created reservations ['7f9fbdb5-04fa-47fc-87fa-f82648d343bb', 'd9334a42-84d1-4bf0-8f12-31831e56e05f', '1bf5e004-bb24-4743-84af-e4d3e751fe25', 'ad364fd7-bcb3-467a-8406-5e918006869e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:19 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:14:19 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "cinder-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "cinder-quobyte-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:14:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-quobyte-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd" acquired by "delete_volume" :: waited 0.042s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:14:20 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2d469-0f7f-4f40-83c0-a9630d16b51a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:20 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.477s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:20 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Deleted volume successfully. Sep 25 16:14:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-31c5a2c4-8315-47af-bfd4-a8beba83d634 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-303f995c-c8b6-4c0d-9c48-4ffd13a57e50-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:20 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd Sep 25 16:14:20 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:20 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd" returned: 0 in 0.763s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:20 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd Sep 25 16:14:20 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:21 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd" returned: 0 in 0.454s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-quobyte-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd" released by "delete_volume" :: held 1.317s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-6b3052ac-3d95-4772-b3aa-81a20c0a75a4 req-88034834-3f7a-4454-a499-205c05ff1df3 tempest-AttachVolumeTestJSON-1132387730 None] Terminate volume connection completed successfully. Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-6b3052ac-3d95-4772-b3aa-81a20c0a75a4 req-88034834-3f7a-4454-a499-205c05ff1df3 tempest-AttachVolumeTestJSON-1132387730 None] Deleting attachment c4d0220d-ada6-4143-a2b0-550c9f1bb117. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Created reservations ['161db840-5727-48af-9ef9-e4efaebe2e87', '7eddd55e-b53f-44b9-911b-6a8f3d23d61e', 'bd250370-3624-4434-8365-b8393a4e883b', '3fea0974-e20b-4183-9f09-c4d45dcf1b2b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:21 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:14:21 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:22 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.527s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:22 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:14:22 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Deleted volume successfully. Sep 25 16:14:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f4e70ca5-265f-4ca3-b16c-b5499f027890 tempest-VolumesListTestJSON-835057725 None] Lock "cinder-18b380ec-c191-4ecc-8aa9-500a9d9e2cdd-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:14:31 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=47,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:14:32 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=48,cinder:UPDATE=64,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Flow 'volume_create_manager' (0cd13c71-0cdf-4fa6-86bd-80d366d103f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad400726-fbfc-4d4b-a899-035588688b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad400726-fbfc-4d4b-a899-035588688b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1467032042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d432ff-36ce-4e64-b163-8ccc58916d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d0c90c57f64ca6bf6963ee7ff6ddf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:48Z,use_quota=True,user_id='3d8381aac2274a73a49727f43431911b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9142546-1992-4825-ab59-c1c9de217efc),volume_type_id=a9142546-1992-4825-ab59-c1c9de217efc)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d00192-37a5-4b4b-8e02-21106abb270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d00192-37a5-4b4b-8e02-21106abb270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b755dd52-5c2c-4c4a-a391-e5a7afbbb91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b755dd52-5c2c-4c4a-a391-e5a7afbbb91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d432ff-36ce-4e64-b163-8ccc58916d1f', 'volume_name': 'volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816d5ddc-a4f7-41ea-ab90-591530693751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816d5ddc-a4f7-41ea-ab90-591530693751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0900ee49-02f5-4262-a04e-9dd5bec62ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume e5d432ff-36ce-4e64-b163-8ccc58916d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f', 'volume_size': 1} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1467032042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d432ff-36ce-4e64-b163-8ccc58916d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d0c90c57f64ca6bf6963ee7ff6ddf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:48Z,use_quota=True,user_id='3d8381aac2274a73a49727f43431911b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9142546-1992-4825-ab59-c1c9de217efc),volume_type_id=a9142546-1992-4825-ab59-c1c9de217efc)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Creating volume e5d432ff-36ce-4e64-b163-8ccc58916d1f {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:48 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:48 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f 1073741824 Sep 25 16:14:48 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-0b4c696c-39e7-4c96-b2be-3b5dbfe17a34 req-bb3bb4c0-3a66-432d-93a3-6903cd87e897 tempest-AttachVolumeNegativeTest-1878192140 None] Terminate volume connection completed successfully. Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-0b4c696c-39e7-4c96-b2be-3b5dbfe17a34 req-bb3bb4c0-3a66-432d-93a3-6903cd87e897 tempest-AttachVolumeNegativeTest-1878192140 None] Deleting attachment bf2ee355-edc4-4be3-b8fa-f393fa7703ed. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Flow 'volume_create_manager' (6c5f8299-551e-4ff3-a6b8-9514bf72240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c247d7-9dca-480e-8fb4-b72481896162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c247d7-9dca-480e-8fb4-b72481896162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2053738970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c7f9da-81ab-43b0-8ddb-494245a7ddb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d0c90c57f64ca6bf6963ee7ff6ddf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:49Z,use_quota=True,user_id='3d8381aac2274a73a49727f43431911b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b01f9b4-b9dd-47d6-b18e-3a8212924f32),volume_type_id=2b01f9b4-b9dd-47d6-b18e-3a8212924f32)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25b3d9c-f267-4132-8044-21a4b186a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25b3d9c-f267-4132-8044-21a4b186a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332da413-41e3-4aa3-a639-f6e43a9a6ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332da413-41e3-4aa3-a639-f6e43a9a6ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c7f9da-81ab-43b0-8ddb-494245a7ddb7', 'volume_name': 'volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8fc12c-2dad-4f52-8026-0b38cf99b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8fc12c-2dad-4f52-8026-0b38cf99b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d400ac-88f1-4957-b998-265b19ac7c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume d7c7f9da-81ab-43b0-8ddb-494245a7ddb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7', 'volume_size': 1} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:49 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f 1073741824" returned: 0 in 0.870s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:49 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f Sep 25 16:14:49 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:49 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f" returned: 0 in 0.482s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2053738970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c7f9da-81ab-43b0-8ddb-494245a7ddb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d0c90c57f64ca6bf6963ee7ff6ddf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:49Z,use_quota=True,user_id='3d8381aac2274a73a49727f43431911b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b01f9b4-b9dd-47d6-b18e-3a8212924f32),volume_type_id=2b01f9b4-b9dd-47d6-b18e-3a8212924f32)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Creating volume d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:49 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:49 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 1073741824 Sep 25 16:14:49 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0900ee49-02f5-4262-a04e-9dd5bec62ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a926faf7-bad9-4573-8bc4-dd8738d873b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f (e5d432ff-36ce-4e64-b163-8ccc58916d1f): created successfully Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a926faf7-bad9-4573-8bc4-dd8738d873b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Flow 'volume_create_manager' (0cd13c71-0cdf-4fa6-86bd-80d366d103f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-93103565-3e9a-43f3-b322-8331690a767a tempest-TestInstancesWithCinderVolumes-1596987495 None] Created volume successfully. Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Flow 'volume_create_manager' (11277eb0-ce93-44d1-9e14-e624ead51552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5d54e6-c437-47af-860d-fd9e8c869185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5d54e6-c437-47af-860d-fd9e8c869185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-196222245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2290a373-118f-458f-9f08-a976debddb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d0c90c57f64ca6bf6963ee7ff6ddf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:50Z,use_quota=True,user_id='3d8381aac2274a73a49727f43431911b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb51bca1-aa50-40a4-a736-ff2cbec5c9aa),volume_type_id=bb51bca1-aa50-40a4-a736-ff2cbec5c9aa)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eab3dd-71c1-4fff-a4a6-7a29b25159af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eab3dd-71c1-4fff-a4a6-7a29b25159af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1cf0a1-7f54-4ea8-9574-5273e1b0e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:14:50 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 1073741824" returned: 0 in 0.842s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1cf0a1-7f54-4ea8-9574-5273e1b0e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2290a373-118f-458f-9f08-a976debddb54', 'volume_name': 'volume-2290a373-118f-458f-9f08-a976debddb54', 'volume_size': 1, 'image_id': '031d3378-2c73-4302-a46f-bb2b921792f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/031d3378-2c73-4302-a46f-bb2b921792f5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--962376159', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44d0c90c57f64ca6bf6963ee7ff6ddf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '031d3378-2c73-4302-a46f-bb2b921792f5', 'created_at': datetime.datetime(2026, 9, 25, 14, 14, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/031d3378-2c73-4302-a46f-bb2b921792f5/file', 'properties': {}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3beaa962-7d1f-4d1d-90fb-a3113e9bda97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:50 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 Sep 25 16:14:50 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3beaa962-7d1f-4d1d-90fb-a3113e9bda97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd18431-b060-4715-a53c-e1b2a3dccb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume 2290a373-118f-458f-9f08-a976debddb54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2290a373-118f-458f-9f08-a976debddb54', 'volume_size': 1, 'image_id': '031d3378-2c73-4302-a46f-bb2b921792f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/031d3378-2c73-4302-a46f-bb2b921792f5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--962376159', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44d0c90c57f64ca6bf6963ee7ff6ddf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '031d3378-2c73-4302-a46f-bb2b921792f5', 'created_at': datetime.datetime(2026, 9, 25, 14, 14, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/031d3378-2c73-4302-a46f-bb2b921792f5/file', 'properties': {}}, 'image_service': } Sep 25 16:14:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Trying to clone 2290a373-118f-458f-9f08-a976debddb54 from image 031d3378-2c73-4302-a46f-bb2b921792f5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/031d3378-2c73-4302-a46f-bb2b921792f5', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:14:51 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7" returned: 0 in 0.530s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d400ac-88f1-4957-b998-265b19ac7c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e9c85e-4c94-454f-b047-3e5acb4e0486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:14:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 (d7c7f9da-81ab-43b0-8ddb-494245a7ddb7): created successfully Sep 25 16:14:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e9c85e-4c94-454f-b047-3e5acb4e0486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:14:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Flow 'volume_create_manager' (6c5f8299-551e-4ff3-a6b8-9514bf72240e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:14:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-608b6edf-44f3-4727-b306-dd5861adc677 tempest-TestInstancesWithCinderVolumes-1596987495 None] Created volume successfully. Sep 25 16:14:56 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD, size 20.69 MB, duration 6.03 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:14:56 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Image download 20.69 MB at 3.43 MB/s Sep 25 16:14:56 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dcae93-15d9-40e7-975d-d8032e36b372]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:57 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD Sep 25 16:14:57 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:57 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Temporary image 031d3378-2c73-4302-a46f-bb2b921792f5 is fetched for user 3d8381aac2274a73a49727f43431911b. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6fa7c-fa0d-4b2f-ab7d-bda30c45149a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:57 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD Sep 25 16:14:57 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:57 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-196222245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2290a373-118f-458f-9f08-a976debddb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d0c90c57f64ca6bf6963ee7ff6ddf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:14:50Z,use_quota=True,user_id='3d8381aac2274a73a49727f43431911b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb51bca1-aa50-40a4-a736-ff2cbec5c9aa),volume_type_id=bb51bca1-aa50-40a4-a736-ff2cbec5c9aa)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Creating volume 2290a373-118f-458f-9f08-a976debddb54 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:14:57 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:14:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:57 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 1073741824 Sep 25 16:14:57 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:58 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 1073741824" returned: 0 in 0.826s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:58 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 Sep 25 16:14:58 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:59 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54" returned: 0 in 0.353s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Attempting download of 031d3378-2c73-4302-a46f-bb2b921792f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/031d3378-2c73-4302-a46f-bb2b921792f5', 'metadata': {}}])) to volume 2290a373-118f-458f-9f08-a976debddb54. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[60427629-acfe-4f1f-aed0-d0c734d3e315]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_031d3378-2c73-4302-a46f-bb2b921792f5_oq27noor {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:59 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_031d3378-2c73-4302-a46f-bb2b921792f5_oq27noor Sep 25 16:14:59 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:14:59 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_031d3378-2c73-4302-a46f-bb2b921792f5_oq27noor" returned: 0 in 0.465s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:14:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_031d3378-2c73-4302-a46f-bb2b921792f5_oq27noor {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:14:59 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_031d3378-2c73-4302-a46f-bb2b921792f5_oq27noor Sep 25 16:14:59 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:00 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_031d3378-2c73-4302-a46f-bb2b921792f5_oq27noor" returned: 1 in 0.489s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_031d3378-2c73-4302-a46f-bb2b921792f5_oq27noor' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b50da27-2058-45b5-8da5-53607994bdc9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:00 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD Sep 25 16:15:00 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:00 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1010}} Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 iflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:00 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 iflag=direct Sep 25 16:15:00 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:00 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 iflag=direct" returned: 0 in 0.359s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:01 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 oflag=direct Sep 25 16:15:01 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:01 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 oflag=direct" returned: 0 in 0.395s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:01 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:15:01 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:02 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 0.975s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_031d3378-2c73-4302-a46f-bb2b921792f5_k3pbd33gdevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54, size 21.00 MB, duration 1.00 sec {{(pid=87467) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:15:02 devstack cinder-volume[87467]: INFO cinder.volume.volume_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume copy 21.00 MB at 21.00 MB/s Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:02 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 1G Sep 25 16:15:02 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:02 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 1G" returned: 0 in 0.463s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Downloaded image 031d3378-2c73-4302-a46f-bb2b921792f5 ((None, [{'url': 'file:///opt/stack/data/glance/images/031d3378-2c73-4302-a46f-bb2b921792f5', 'metadata': {}}])) to volume 2290a373-118f-458f-9f08-a976debddb54 successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Temporary image 031d3378-2c73-4302-a46f-bb2b921792f5 for user 3d8381aac2274a73a49727f43431911b is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Marking volume 2290a373-118f-458f-9f08-a976debddb54 as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Copying metadata from image 031d3378-2c73-4302-a46f-bb2b921792f5 to 2290a373-118f-458f-9f08-a976debddb54. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Creating volume glance metadata for volume 2290a373-118f-458f-9f08-a976debddb54 backed by image 031d3378-2c73-4302-a46f-bb2b921792f5 with: {'image_id': '031d3378-2c73-4302-a46f-bb2b921792f5', 'image_name': 'tempest-scenario-img--962376159', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:15:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd18431-b060-4715-a53c-e1b2a3dccb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2290a373-118f-458f-9f08-a976debddb54', 'volume_size': 1, 'image_id': '031d3378-2c73-4302-a46f-bb2b921792f5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/031d3378-2c73-4302-a46f-bb2b921792f5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--962376159', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44d0c90c57f64ca6bf6963ee7ff6ddf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '031d3378-2c73-4302-a46f-bb2b921792f5', 'created_at': datetime.datetime(2026, 9, 25, 14, 14, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/031d3378-2c73-4302-a46f-bb2b921792f5/file', 'properties': {}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2329b78-fbe3-4d97-a537-a39f29e07ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:03 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Volume volume-2290a373-118f-458f-9f08-a976debddb54 (2290a373-118f-458f-9f08-a976debddb54): created successfully Sep 25 16:15:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2329b78-fbe3-4d97-a537-a39f29e07ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Flow 'volume_create_manager' (11277eb0-ce93-44d1-9e14-e624ead51552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:03 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e925a536-c3ee-47d2-b4b9-1ce41455f603 tempest-TestInstancesWithCinderVolumes-1596987495 None] Created volume successfully. Sep 25 16:15:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-1dcf4d64-14d2-4377-a8d9-d47e8d9c282a req-6aacc4db-57f7-45fc-a54b-2f1ce99baa06 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-1dcf4d64-14d2-4377-a8d9-d47e8d9c282a req-6aacc4db-57f7-45fc-a54b-2f1ce99baa06 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-1dcf4d64-14d2-4377-a8d9-d47e8d9c282a req-6aacc4db-57f7-45fc-a54b-2f1ce99baa06 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-1dcf4d64-14d2-4377-a8d9-d47e8d9c282a req-6aacc4db-57f7-45fc-a54b-2f1ce99baa06 tempest-TestInstancesWithCinderVolumes-1596987495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-2290a373-118f-458f-9f08-a976debddb54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b988076-5a84-46c7-9c08-bb5e9b2d27e5', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-1dcf4d64-14d2-4377-a8d9-d47e8d9c282a req-6aacc4db-57f7-45fc-a54b-2f1ce99baa06 tempest-TestInstancesWithCinderVolumes-1596987495 None] attachment_update completed successfully. Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:15 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:15:15 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:15 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.552s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:15:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:15:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:15:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Flow 'volume_create_manager' (60607e8c-0155-4b38-9dcd-739caff93d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0fd2457-1b18-4491-a10a-e38ec45454f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0fd2457-1b18-4491-a10a-e38ec45454f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-169786059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985ac402-6f54-438e-9eb9-7bbfb5ebf49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891a6e4a6cf94980ade820118e0d8dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:17Z,use_quota=True,user_id='6cdaa2f4cb1c47d5ac54592fb2c64d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1940000-4346-4300-a35a-6eb5cbf325c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1940000-4346-4300-a35a-6eb5cbf325c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d0fcb7-fa08-43dc-bb3d-682ed3d6f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:17 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:15:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d0fcb7-fa08-43dc-bb3d-682ed3d6f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '985ac402-6f54-438e-9eb9-7bbfb5ebf49f', 'volume_name': 'volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b91c1c6-83a2-44f4-b507-380802642722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b91c1c6-83a2-44f4-b507-380802642722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bbeb23-547e-4fdd-8d49-8a56d3f2182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:18 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Volume 985ac402-6f54-438e-9eb9-7bbfb5ebf49f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:15:18 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Trying to clone 985ac402-6f54-438e-9eb9-7bbfb5ebf49f from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:15:19 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:15:19 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:15:19 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c833e30-59f2-4173-8e4f-9264f5ca20f4]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:19 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD Sep 25 16:15:19 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:19 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:19 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 is fetched for user 6cdaa2f4cb1c47d5ac54592fb2c64d50. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba02628a-ba3c-4ed0-b366-463b2c4a999b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:20 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD Sep 25 16:15:20 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:20 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-169786059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985ac402-6f54-438e-9eb9-7bbfb5ebf49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891a6e4a6cf94980ade820118e0d8dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:17Z,use_quota=True,user_id='6cdaa2f4cb1c47d5ac54592fb2c64d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Creating volume 985ac402-6f54-438e-9eb9-7bbfb5ebf49f {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:20 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:15:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:20 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f 1073741824 Sep 25 16:15:20 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:21 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f 1073741824" returned: 0 in 0.826s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:21 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f Sep 25 16:15:21 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:22 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f" returned: 0 in 0.565s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:22 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Attempting download of fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 985ac402-6f54-438e-9eb9-7bbfb5ebf49f. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:15:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[60524b0e-0ab4-40e3-a9db-d72bfb4bdde8]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0j1gzdc4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:22 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0j1gzdc4 Sep 25 16:15:22 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:23 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0j1gzdc4" returned: 0 in 0.904s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0j1gzdc4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:23 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0j1gzdc4 Sep 25 16:15:23 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:24 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0j1gzdc4" returned: 1 in 0.972s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_0j1gzdc4' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:15:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7990926-a960-4eff-9df3-b795c355dcca]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:15:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:24 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD Sep 25 16:15:24 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:25 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD" returned: 0 in 1.805s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:26 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1010}} Sep 25 16:15:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f iflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:26 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f iflag=direct Sep 25 16:15:26 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:26 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f iflag=direct" returned: 0 in 0.599s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:26 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f oflag=direct Sep 25 16:15:26 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:27 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f oflag=direct" returned: 0 in 1.127s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:27 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:15:27 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:29 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 1.984s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:29 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_gvvp65ahdevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f, size 21.00 MB, duration 1.99 sec {{(pid=87467) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:15:29 devstack cinder-volume[87467]: INFO cinder.volume.volume_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Volume copy 21.00 MB at 10.55 MB/s Sep 25 16:15:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:29 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f 1G Sep 25 16:15:29 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:30 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f 1G" returned: 0 in 0.817s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:30 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Downloaded image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume 985ac402-6f54-438e-9eb9-7bbfb5ebf49f successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:15:30 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 for user 6cdaa2f4cb1c47d5ac54592fb2c64d50 is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:15:30 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Marking volume 985ac402-6f54-438e-9eb9-7bbfb5ebf49f as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:15:30 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Copying metadata from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 to 985ac402-6f54-438e-9eb9-7bbfb5ebf49f. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:15:30 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Creating volume glance metadata for volume 985ac402-6f54-438e-9eb9-7bbfb5ebf49f backed by image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:15:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bbeb23-547e-4fdd-8d49-8a56d3f2182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f58793-9de7-4122-9d6e-816ade68bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:31 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Volume volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f (985ac402-6f54-438e-9eb9-7bbfb5ebf49f): created successfully Sep 25 16:15:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f58793-9de7-4122-9d6e-816ade68bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Flow 'volume_create_manager' (60607e8c-0155-4b38-9dcd-739caff93d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3edc11bf-dc90-4cf4-acda-2a0417f73bd3 tempest-TestShelveInstance-233553811 None] Created volume successfully. Sep 25 16:15:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=30,cinder:UPDATE=17,cinder:INSERT=15,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=17,cinder:SELECT=28,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-bf8ed27e-8c65-4341-b673-8701e0afb073 req-4d2960ce-0f56-41c8-856f-f895f719e8db tempest-TestShelveInstance-233553811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-bf8ed27e-8c65-4341-b673-8701e0afb073 req-4d2960ce-0f56-41c8-856f-f895f719e8db tempest-TestShelveInstance-233553811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-bf8ed27e-8c65-4341-b673-8701e0afb073 req-4d2960ce-0f56-41c8-856f-f895f719e8db tempest-TestShelveInstance-233553811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-bf8ed27e-8c65-4341-b673-8701e0afb073 req-4d2960ce-0f56-41c8-856f-f895f719e8db tempest-TestShelveInstance-233553811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2635cce-57ab-41aa-8817-6c4df0b470a9', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:43 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-bf8ed27e-8c65-4341-b673-8701e0afb073 req-4d2960ce-0f56-41c8-856f-f895f719e8db tempest-TestShelveInstance-233553811 None] attachment_update completed successfully. Sep 25 16:15:53 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:53 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Flow 'volume_create_manager' (0eaaad4e-5083-4c98-8af9-8df635ebf445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d66e9dc-f11f-429e-8138-64e92183a3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d66e9dc-f11f-429e-8138-64e92183a3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-763464127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b53bc0-99f0-4376-bcdb-ca8d87310efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c759148302e454fa13a5b8009906ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:54Z,use_quota=True,user_id='7ca41a04be15467baf52177421a20d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324a01bd-6cfd-4542-b665-01537a6fa0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324a01bd-6cfd-4542-b665-01537a6fa0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c292a518-00a7-43a0-b568-99a00f4f6c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c292a518-00a7-43a0-b568-99a00f4f6c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b53bc0-99f0-4376-bcdb-ca8d87310efb', 'volume_name': 'volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdb0001-b0a1-46a6-a434-76ea19fe8bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdb0001-b0a1-46a6-a434-76ea19fe8bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c345382-1603-4ecc-8869-fbc28a74b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:54 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Volume 57b53bc0-99f0-4376-bcdb-ca8d87310efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb', 'volume_size': 1} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-763464127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b53bc0-99f0-4376-bcdb-ca8d87310efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c759148302e454fa13a5b8009906ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:15:54Z,use_quota=True,user_id='7ca41a04be15467baf52177421a20d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Creating volume 57b53bc0-99f0-4376-bcdb-ca8d87310efb {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:15:54 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:54 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb 1073741824 Sep 25 16:15:54 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:54 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb 1073741824" returned: 0 in 0.545s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:15:54 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb Sep 25 16:15:54 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:15:55 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 25 16:15:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb" returned: 0 in 0.359s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:15:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:15:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c345382-1603-4ecc-8869-fbc28a74b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f83a120-d4a9-42bc-9b45-19f3810c61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:15:55 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Volume volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb (57b53bc0-99f0-4376-bcdb-ca8d87310efb): created successfully Sep 25 16:15:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f83a120-d4a9-42bc-9b45-19f3810c61b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:15:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Flow 'volume_create_manager' (0eaaad4e-5083-4c98-8af9-8df635ebf445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:15:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0f9bae5e-49d8-49a4-92d6-07689b8da616 tempest-AttachVolumeNegativeTest-1878192140 None] Created volume successfully. Sep 25 16:15:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-2a7333ce-85b3-4867-9983-0f14c57b2949 req-23bf7aac-2b24-44f6-aeed-538b2ccb5684 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:15:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-2a7333ce-85b3-4867-9983-0f14c57b2949 req-23bf7aac-2b24-44f6-aeed-538b2ccb5684 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:15:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-2a7333ce-85b3-4867-9983-0f14c57b2949 req-23bf7aac-2b24-44f6-aeed-538b2ccb5684 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:15:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-2a7333ce-85b3-4867-9983-0f14c57b2949 req-23bf7aac-2b24-44f6-aeed-538b2ccb5684 tempest-AttachVolumeNegativeTest-1878192140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6760d8fd-5048-462e-87b7-18999867e9b9', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:15:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-2a7333ce-85b3-4867-9983-0f14c57b2949 req-23bf7aac-2b24-44f6-aeed-538b2ccb5684 tempest-AttachVolumeNegativeTest-1878192140 None] attachment_update completed successfully. Sep 25 16:16:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-de2bcc0a-a741-4fa1-b017-b0b210e50097 req-6ef0cd43-5cd8-4e4c-92f6-ca41fa9e3966 tempest-AttachVolumeNegativeTest-1878192140 None] Terminate volume connection completed successfully. Sep 25 16:16:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-de2bcc0a-a741-4fa1-b017-b0b210e50097 req-6ef0cd43-5cd8-4e4c-92f6-ca41fa9e3966 tempest-AttachVolumeNegativeTest-1878192140 None] Deleting attachment 6760d8fd-5048-462e-87b7-18999867e9b9. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Flow 'volume_create_manager' (4a532fa1-6616-43e7-ba3e-71291d8e4d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e785e-b3a3-4222-bbf7-70cbb339ffb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e785e-b3a3-4222-bbf7-70cbb339ffb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-302884618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89bc96d-f096-461e-8fa6-f1c52161f597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f4e6af9ef44805a8b75645684ce791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:02Z,use_quota=True,user_id='046fe45aa0a245129074601fcab98665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcbe13d-f5d5-4bcc-a437-6846cde0e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcbe13d-f5d5-4bcc-a437-6846cde0e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f4fa16-9fd6-473f-bbce-bf2b590fcb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f4fa16-9fd6-473f-bbce-bf2b590fcb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd89bc96d-f096-461e-8fa6-f1c52161f597', 'volume_name': 'volume-d89bc96d-f096-461e-8fa6-f1c52161f597', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76035b9d-6b12-4814-9959-315109df1283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76035b9d-6b12-4814-9959-315109df1283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3fe542-0eb7-43fd-973a-e550818a75c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:02 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Volume d89bc96d-f096-461e-8fa6-f1c52161f597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d89bc96d-f096-461e-8fa6-f1c52161f597', 'volume_size': 1} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-302884618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89bc96d-f096-461e-8fa6-f1c52161f597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f4e6af9ef44805a8b75645684ce791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:02Z,use_quota=True,user_id='046fe45aa0a245129074601fcab98665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Creating volume d89bc96d-f096-461e-8fa6-f1c52161f597 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:02 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:16:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:02 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 1073741824 Sep 25 16:16:02 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:03 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 1073741824" returned: 0 in 0.771s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:03 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 Sep 25 16:16:03 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:04 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597" returned: 0 in 0.407s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3fe542-0eb7-43fd-973a-e550818a75c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89bc96d-f096-461e-8fa6-f1c52161f597', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ec1aed-60b3-44a8-8346-21e3370bd9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:04 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Volume volume-d89bc96d-f096-461e-8fa6-f1c52161f597 (d89bc96d-f096-461e-8fa6-f1c52161f597): created successfully Sep 25 16:16:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ec1aed-60b3-44a8-8346-21e3370bd9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Flow 'volume_create_manager' (4a532fa1-6616-43e7-ba3e-71291d8e4d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-96e096d3-525f-4480-80f0-210c9d2aef0e tempest-AttachVolumeTestJSON-1132387730 None] Created volume successfully. Sep 25 16:16:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-95053818-5be2-4892-a320-1420c83d8a11 req-d2d6ea92-9e1f-4201-a94b-2e340e913438 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-95053818-5be2-4892-a320-1420c83d8a11 req-d2d6ea92-9e1f-4201-a94b-2e340e913438 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-95053818-5be2-4892-a320-1420c83d8a11 req-d2d6ea92-9e1f-4201-a94b-2e340e913438 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-95053818-5be2-4892-a320-1420c83d8a11 req-d2d6ea92-9e1f-4201-a94b-2e340e913438 tempest-AttachVolumeTestJSON-1132387730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-d89bc96d-f096-461e-8fa6-f1c52161f597', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78c6c765-b4ec-4782-8b57-bc62b0a71f50', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:16:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-95053818-5be2-4892-a320-1420c83d8a11 req-d2d6ea92-9e1f-4201-a94b-2e340e913438 tempest-AttachVolumeTestJSON-1132387730 None] attachment_update completed successfully. Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-9f2b3118-f92c-4eb7-b621-c9a8975d12c1 req-e57feaab-8aca-49c4-9cf1-34f983ad7b7c tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-9f2b3118-f92c-4eb7-b621-c9a8975d12c1 req-e57feaab-8aca-49c4-9cf1-34f983ad7b7c tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-9f2b3118-f92c-4eb7-b621-c9a8975d12c1 req-e57feaab-8aca-49c4-9cf1-34f983ad7b7c tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-9f2b3118-f92c-4eb7-b621-c9a8975d12c1 req-e57feaab-8aca-49c4-9cf1-34f983ad7b7c tempest-TestInstancesWithCinderVolumes-1596987495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41b0ea99-6b8a-478b-a05a-f2c4305c4d40', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:16:08 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-9f2b3118-f92c-4eb7-b621-c9a8975d12c1 req-e57feaab-8aca-49c4-9cf1-34f983ad7b7c tempest-TestInstancesWithCinderVolumes-1596987495 None] attachment_update completed successfully. Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Flow 'volume_create_manager' (604e2952-d0dc-4495-9df1-06f26fb365eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be939ae8-e77e-44f7-989a-2def98f6e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be939ae8-e77e-44f7-989a-2def98f6e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-290726687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f857f3c4-2c78-4caf-90d9-b84c5882b879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f4e6af9ef44805a8b75645684ce791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:09Z,use_quota=True,user_id='046fe45aa0a245129074601fcab98665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3caabd00-776f-424c-bd78-ebcf0278974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3caabd00-776f-424c-bd78-ebcf0278974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:08 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b26b85-9cfb-4e58-8c81-5c551873a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b26b85-9cfb-4e58-8c81-5c551873a95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f857f3c4-2c78-4caf-90d9-b84c5882b879', 'volume_name': 'volume-f857f3c4-2c78-4caf-90d9-b84c5882b879', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c58e16-617b-4687-ab7f-6863a4e362ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c58e16-617b-4687-ab7f-6863a4e362ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c55b67-5cdb-494e-b3f3-f6108493b256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:09 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Volume f857f3c4-2c78-4caf-90d9-b84c5882b879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f857f3c4-2c78-4caf-90d9-b84c5882b879', 'volume_size': 1} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-290726687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f857f3c4-2c78-4caf-90d9-b84c5882b879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f4e6af9ef44805a8b75645684ce791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:09Z,use_quota=True,user_id='046fe45aa0a245129074601fcab98665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Creating volume f857f3c4-2c78-4caf-90d9-b84c5882b879 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:09 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:09 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 1073741824 Sep 25 16:16:09 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:09 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 1073741824" returned: 0 in 0.847s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:09 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 Sep 25 16:16:09 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:10 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c55b67-5cdb-494e-b3f3-f6108493b256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f857f3c4-2c78-4caf-90d9-b84c5882b879', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5387a19b-3d71-45d2-8dda-df078164573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:10 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Volume volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 (f857f3c4-2c78-4caf-90d9-b84c5882b879): created successfully Sep 25 16:16:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5387a19b-3d71-45d2-8dda-df078164573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Flow 'volume_create_manager' (604e2952-d0dc-4495-9df1-06f26fb365eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:10 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-cd8fcbfc-5247-468f-a854-4154ec896fcb tempest-AttachVolumeTestJSON-1132387730 None] Created volume successfully. Sep 25 16:16:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-74cba360-af4d-4c04-be20-ac18ee18c236 req-62664809-8f12-4896-a997-913bd0bd1e94 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-74cba360-af4d-4c04-be20-ac18ee18c236 req-62664809-8f12-4896-a997-913bd0bd1e94 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-74cba360-af4d-4c04-be20-ac18ee18c236 req-62664809-8f12-4896-a997-913bd0bd1e94 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-74cba360-af4d-4c04-be20-ac18ee18c236 req-62664809-8f12-4896-a997-913bd0bd1e94 tempest-TestInstancesWithCinderVolumes-1596987495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35a8d7ab-8971-4a21-b2da-29d7102a98a1', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:16:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-74cba360-af4d-4c04-be20-ac18ee18c236 req-62664809-8f12-4896-a997-913bd0bd1e94 tempest-TestInstancesWithCinderVolumes-1596987495 None] attachment_update completed successfully. Sep 25 16:16:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-2f7cec9d-bee4-43ea-a3fb-00011f222f72 req-71ae68c6-64e7-4bf1-8c95-8b0638230627 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-2f7cec9d-bee4-43ea-a3fb-00011f222f72 req-71ae68c6-64e7-4bf1-8c95-8b0638230627 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-2f7cec9d-bee4-43ea-a3fb-00011f222f72 req-71ae68c6-64e7-4bf1-8c95-8b0638230627 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-2f7cec9d-bee4-43ea-a3fb-00011f222f72 req-71ae68c6-64e7-4bf1-8c95-8b0638230627 tempest-AttachVolumeTestJSON-1132387730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-f857f3c4-2c78-4caf-90d9-b84c5882b879', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0feb4d8-65f0-45c5-9a97-88c9c7b21264', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:16:12 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-2f7cec9d-bee4-43ea-a3fb-00011f222f72 req-71ae68c6-64e7-4bf1-8c95-8b0638230627 tempest-AttachVolumeTestJSON-1132387730 None] attachment_update completed successfully. Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:15 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:15 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:15 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.466s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:16:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:16:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-9a23ad8f-4e01-4eb3-98b2-720594214a6a req-c5e3b7fb-7f84-43be-9a5c-fc6bfb8f0a6c tempest-AttachVolumeTestJSON-1132387730 None] Terminate volume connection completed successfully. Sep 25 16:16:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-9a23ad8f-4e01-4eb3-98b2-720594214a6a req-c5e3b7fb-7f84-43be-9a5c-fc6bfb8f0a6c tempest-AttachVolumeTestJSON-1132387730 None] Deleting attachment 78c6c765-b4ec-4782-8b57-bc62b0a71f50. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:16:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-19bcd6da-075f-4d13-9ddd-1b66f9169514 req-45874e7b-090e-4b93-b31b-2487c4b50690 tempest-AttachVolumeTestJSON-1132387730 None] Terminate volume connection completed successfully. Sep 25 16:16:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-19bcd6da-075f-4d13-9ddd-1b66f9169514 req-45874e7b-090e-4b93-b31b-2487c4b50690 tempest-AttachVolumeTestJSON-1132387730 None] Deleting attachment c0feb4d8-65f0-45c5-9a97-88c9c7b21264. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:16:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-36dacb99-931b-4447-82a2-a8f42bc7cf5b req-03a95516-dcf0-4b58-897e-99c2528169c8 tempest-TestInstancesWithCinderVolumes-1596987495 None] Terminate volume connection completed successfully. Sep 25 16:16:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-36dacb99-931b-4447-82a2-a8f42bc7cf5b req-03a95516-dcf0-4b58-897e-99c2528169c8 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deleting attachment 41b0ea99-6b8a-478b-a05a-f2c4305c4d40. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:16:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "cinder-e5d432ff-36ce-4e64-b163-8ccc58916d1f-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-e5d432ff-36ce-4e64-b163-8ccc58916d1f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "cinder-quobyte-e5d432ff-36ce-4e64-b163-8ccc58916d1f" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-quobyte-e5d432ff-36ce-4e64-b163-8ccc58916d1f" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:21 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[26648106-b045-4b25-8439-40cf6c6bfa7e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:21 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f Sep 25 16:16:21 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:22 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f" returned: 0 in 0.763s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:22 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f Sep 25 16:16:22 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:22 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e5d432ff-36ce-4e64-b163-8ccc58916d1f" returned: 0 in 0.842s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-quobyte-e5d432ff-36ce-4e64-b163-8ccc58916d1f" released by "delete_volume" :: held 1.750s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:23 devstack cinder-volume[87467]: WARNING cinder.quota [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2092599046-126051045 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2092599046-126051045, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:16:23 devstack cinder-volume[87467]: WARNING cinder.quota [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2092599046-126051045 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2092599046-126051045, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Created reservations ['0f851643-c267-471f-8c2f-01483c1ae20d', '8370af23-671d-4a8a-9b55-760fb084f437', 'eef5b616-1191-4168-b65c-884dbd360c78', '568967cf-0557-48aa-8580-1643480211dc'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:23 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:23 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:24 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.721s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:24 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deleted volume successfully. Sep 25 16:16:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fd23a37-2868-4072-b984-e7bd314c1b22 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-e5d432ff-36ce-4e64-b163-8ccc58916d1f-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "cinder-f857f3c4-2c78-4caf-90d9-b84c5882b879-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-f857f3c4-2c78-4caf-90d9-b84c5882b879-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "cinder-quobyte-f857f3c4-2c78-4caf-90d9-b84c5882b879" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-quobyte-f857f3c4-2c78-4caf-90d9-b84c5882b879" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0236b7db-540a-4f12-b81d-d328db05acea]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:28 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 Sep 25 16:16:28 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:28 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879" returned: 0 in 0.478s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-d0d899fc-4f79-4e71-a81e-47885ffa178b req-2e2f63e8-70ef-4651-bfde-3c63d6dcf068 tempest-TestInstancesWithCinderVolumes-1596987495 None] Terminate volume connection completed successfully. Sep 25 16:16:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-d0d899fc-4f79-4e71-a81e-47885ffa178b req-2e2f63e8-70ef-4651-bfde-3c63d6dcf068 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deleting attachment 35a8d7ab-8971-4a21-b2da-29d7102a98a1. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:16:28 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879 Sep 25 16:16:28 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:29 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f857f3c4-2c78-4caf-90d9-b84c5882b879" returned: 0 in 0.307s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-quobyte-f857f3c4-2c78-4caf-90d9-b84c5882b879" released by "delete_volume" :: held 0.849s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Created reservations ['e3bf6e37-5220-42ad-9a8d-e3e11b3546d0', 'b0e8382a-56d7-4bac-b56e-afee7158b5a1', '08e56ad9-2354-4fe9-a960-bc544494db6f', '3a61d61c-e6b0-4320-a8ef-47e1a022b730'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "cinder-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "cinder-quobyte-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:29 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:29 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-quobyte-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7" acquired by "delete_volume" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "cinder-d89bc96d-f096-461e-8fa6-f1c52161f597-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51cb570-a58c-41c5-9a7a-a32c41ac2b9e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-d89bc96d-f096-461e-8fa6-f1c52161f597-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "cinder-quobyte-d89bc96d-f096-461e-8fa6-f1c52161f597" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-quobyte-d89bc96d-f096-461e-8fa6-f1c52161f597" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:29 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 Sep 25 16:16:29 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d828fd-b4c7-4a24-92d7-729d80bcbbce]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:29 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 Sep 25 16:16:29 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:30 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.625s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Deleted volume successfully. Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-168fae2f-d27d-49c3-86d6-faae74fc70a1 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-f857f3c4-2c78-4caf-90d9-b84c5882b879-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:30 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7" returned: 0 in 0.759s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:30 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7 Sep 25 16:16:30 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:30 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597" returned: 0 in 0.585s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:30 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597 Sep 25 16:16:30 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:30 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7" returned: 0 in 0.343s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:30 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-quobyte-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7" released by "delete_volume" :: held 1.208s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d89bc96d-f096-461e-8fa6-f1c52161f597" returned: 0 in 0.313s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-quobyte-d89bc96d-f096-461e-8fa6-f1c52161f597" released by "delete_volume" :: held 0.986s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:30 devstack cinder-volume[87467]: WARNING cinder.quota [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-719009029-270633211 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-719009029-270633211, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:16:30 devstack cinder-volume[87467]: WARNING cinder.quota [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-719009029-270633211 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-719009029-270633211, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Created reservations ['d4c15338-c328-4b10-8fe9-01f32b2533eb', '13644859-289e-4054-9dcd-6a6e81f33722', 'ded645b8-7dd0-40b6-bca8-e025afcc590b', '88e92a53-57bd-405f-be99-00fb442b30b0'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:30 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Created reservations ['8763d7e2-e337-42e2-969b-c6b2f0429753', '9959323f-d9dd-443e-bbad-fcf0ede5db0b', 'ba64d9eb-6108-4da3-89ac-0a1fecde40d1', 'dcfedf59-1709-4de5-822a-258794042d13'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:31 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:31 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:31 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:31 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:31 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.388s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Deleted volume successfully. Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bce432d1-741a-47c2-aefe-672080974f70 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-d89bc96d-f096-461e-8fa6-f1c52161f597-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:31 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.586s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deleted volume successfully. Sep 25 16:16:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5c873761-ed64-4832-b600-fe0d73fd7989 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-d7c7f9da-81ab-43b0-8ddb-494245a7ddb7-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "cinder-c5de80a6-56aa-45e2-919c-70dce323edcf-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-c5de80a6-56aa-45e2-919c-70dce323edcf-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "cinder-quobyte-c5de80a6-56aa-45e2-919c-70dce323edcf" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-quobyte-c5de80a6-56aa-45e2-919c-70dce323edcf" acquired by "delete_volume" :: waited 0.049s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:32 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce33276f-5ebb-4438-807e-61dc3c41a62e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:32 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf Sep 25 16:16:32 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:33 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf" returned: 0 in 0.513s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:33 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf Sep 25 16:16:33 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:33 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5de80a6-56aa-45e2-919c-70dce323edcf" returned: 0 in 0.484s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-quobyte-c5de80a6-56aa-45e2-919c-70dce323edcf" released by "delete_volume" :: held 1.096s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:33 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Created reservations ['f1e3c4bb-6201-4cc0-af12-047fa1548ea4', 'bd0518bb-5d49-433f-9cff-36c3288cb32e', '4088f483-1da0-4f02-93a1-55da9ed9fb05', '91e7ec38-2a5a-48d1-a88d-9ca2b17565ad'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:34 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:34 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:34 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.714s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:34 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Deleted volume successfully. Sep 25 16:16:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4e9e3d97-af9e-4c8b-8aff-1de38dd6cf24 tempest-AttachVolumeTestJSON-1132387730 None] Lock "cinder-c5de80a6-56aa-45e2-919c-70dce323edcf-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:38 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-0b64fa02-d119-4342-ad96-f1fa5f71be5f req-8797b017-e045-42bd-b9c9-7d8bb72b4df0 tempest-TestInstancesWithCinderVolumes-1596987495 None] Terminate volume connection completed successfully. Sep 25 16:16:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-0b64fa02-d119-4342-ad96-f1fa5f71be5f req-8797b017-e045-42bd-b9c9-7d8bb72b4df0 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deleting attachment 2b988076-5a84-46c7-9c08-bb5e9b2d27e5. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:16:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "cinder-2290a373-118f-458f-9f08-a976debddb54-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-2290a373-118f-458f-9f08-a976debddb54-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "cinder-quobyte-2290a373-118f-458f-9f08-a976debddb54" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-quobyte-2290a373-118f-458f-9f08-a976debddb54" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab23862-6756-4316-8a1e-f71f22d93ef9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:40 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 Sep 25 16:16:40 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:40 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54" returned: 0 in 0.737s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:40 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54 Sep 25 16:16:40 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:41 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2290a373-118f-458f-9f08-a976debddb54" returned: 0 in 0.535s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-quobyte-2290a373-118f-458f-9f08-a976debddb54" released by "delete_volume" :: held 1.356s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:41 devstack cinder-volume[87467]: WARNING cinder.quota [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661530356-521228347 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661530356-521228347, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:16:41 devstack cinder-volume[87467]: WARNING cinder.quota [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661530356-521228347 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661530356-521228347, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Created reservations ['adce5fb3-6631-436d-b59a-8f7996f92e89', '2019c89a-a37d-4bca-b18e-f1bcf0581a02', '33999fcc-cce6-4c9b-86d0-3c48db0220b8', '3fb1db98-eab6-4b63-9f9c-6053299ece28'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:41 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:41 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-ba46571a-c738-4d77-8c21-626e2dd5733f req-2f1edfb9-84a4-468e-a777-cc3bce6973dd tempest-TestShelveInstance-233553811 None] Terminate volume connection completed successfully. Sep 25 16:16:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-ba46571a-c738-4d77-8c21-626e2dd5733f req-2f1edfb9-84a4-468e-a777-cc3bce6973dd tempest-TestShelveInstance-233553811 None] Deleting attachment d2635cce-57ab-41aa-8817-6c4df0b470a9. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:16:42 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.664s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:42 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Deleted volume successfully. Sep 25 16:16:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f1719309-00d8-45fd-9fc2-3cb7cc411410 tempest-TestInstancesWithCinderVolumes-1596987495 None] Lock "cinder-2290a373-118f-458f-9f08-a976debddb54-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-5dab5257-e195-4a86-a104-dd6d9fb59fef req-72bf08e9-9496-4ecc-a6a7-88a08ae4a48c tempest-TestShelveInstance-233553811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-5dab5257-e195-4a86-a104-dd6d9fb59fef req-72bf08e9-9496-4ecc-a6a7-88a08ae4a48c tempest-TestShelveInstance-233553811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-5dab5257-e195-4a86-a104-dd6d9fb59fef req-72bf08e9-9496-4ecc-a6a7-88a08ae4a48c tempest-TestShelveInstance-233553811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-5dab5257-e195-4a86-a104-dd6d9fb59fef req-72bf08e9-9496-4ecc-a6a7-88a08ae4a48c tempest-TestShelveInstance-233553811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7436296-a139-4245-a0d4-22694311a61d', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:16:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-5dab5257-e195-4a86-a104-dd6d9fb59fef req-72bf08e9-9496-4ecc-a6a7-88a08ae4a48c tempest-TestShelveInstance-233553811 None] attachment_update completed successfully. Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Flow 'volume_create_manager' (874b1bc5-02cf-42da-9be2-8ef26f8aa5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fb789c-84e6-48a0-bb1c-e16f68b773cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fb789c-84e6-48a0-bb1c-e16f68b773cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-65594180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5606a83-ad68-4fc4-8230-86a235e73c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c759148302e454fa13a5b8009906ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:50Z,use_quota=True,user_id='7ca41a04be15467baf52177421a20d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940ba6ba-c177-487b-b0b9-475799b423b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940ba6ba-c177-487b-b0b9-475799b423b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031488e9-a19d-49a1-8877-a0892b7dd48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031488e9-a19d-49a1-8877-a0892b7dd48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5606a83-ad68-4fc4-8230-86a235e73c91', 'volume_name': 'volume-c5606a83-ad68-4fc4-8230-86a235e73c91', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e7ca68-de1d-4071-9c44-d55ce1ddac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e7ca68-de1d-4071-9c44-d55ce1ddac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d7e743-ed41-41c9-a1f4-36ac3b2e95c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Volume c5606a83-ad68-4fc4-8230-86a235e73c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5606a83-ad68-4fc4-8230-86a235e73c91', 'volume_size': 1} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-65594180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5606a83-ad68-4fc4-8230-86a235e73c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c759148302e454fa13a5b8009906ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:50Z,use_quota=True,user_id='7ca41a04be15467baf52177421a20d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Creating volume c5606a83-ad68-4fc4-8230-86a235e73c91 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:16:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:50 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 1073741824 Sep 25 16:16:50 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:51 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 1073741824" returned: 0 in 0.819s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:51 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 Sep 25 16:16:51 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Flow 'volume_create_manager' (034bec52-bb6f-49f0-a4e9-061daf0e927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43392044-c205-4f95-8f09-3bb649e1b55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43392044-c205-4f95-8f09-3bb649e1b55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1770148174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb93c8c1-ecd0-4d56-9da5-72f90e889db1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6febc1e45fa444c7a29b3b9fe77d4a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:52Z,use_quota=True,user_id='b97afe3227704c80b6619c7498582dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:51 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816600f5-aac9-466d-ba39-43f650db477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816600f5-aac9-466d-ba39-43f650db477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698207dd-9511-4d59-bbed-3810540614f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698207dd-9511-4d59-bbed-3810540614f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb93c8c1-ecd0-4d56-9da5-72f90e889db1', 'volume_name': 'volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5badab80-9a6f-44ae-be0b-bbe231de76f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5badab80-9a6f-44ae-be0b-bbe231de76f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab1c71a-ec5b-4b11-9bdd-086dd67b0e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Volume eb93c8c1-ecd0-4d56-9da5-72f90e889db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1', 'volume_size': 1} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91" returned: 0 in 0.575s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1770148174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb93c8c1-ecd0-4d56-9da5-72f90e889db1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6febc1e45fa444c7a29b3b9fe77d4a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:16:52Z,use_quota=True,user_id='b97afe3227704c80b6619c7498582dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Creating volume eb93c8c1-ecd0-4d56-9da5-72f90e889db1 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:16:51 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:16:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:52 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 1073741824 Sep 25 16:16:52 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d7e743-ed41-41c9-a1f4-36ac3b2e95c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5606a83-ad68-4fc4-8230-86a235e73c91', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294f3ecb-6d48-4ff7-9918-c13ea0b37c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Volume volume-c5606a83-ad68-4fc4-8230-86a235e73c91 (c5606a83-ad68-4fc4-8230-86a235e73c91): created successfully Sep 25 16:16:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294f3ecb-6d48-4ff7-9918-c13ea0b37c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Flow 'volume_create_manager' (874b1bc5-02cf-42da-9be2-8ef26f8aa5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3455151a-1edf-4e16-93ba-74ac5033ec20 tempest-AttachVolumeNegativeTest-1878192140 None] Created volume successfully. Sep 25 16:16:52 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 1073741824" returned: 0 in 0.749s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:52 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 Sep 25 16:16:52 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:53 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1" returned: 0 in 0.651s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab1c71a-ec5b-4b11-9bdd-086dd67b0e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4878823-1e97-4886-8710-859a3ba160cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=89,cinder:UPDATE=73,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Volume volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 (eb93c8c1-ecd0-4d56-9da5-72f90e889db1): created successfully Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4878823-1e97-4886-8710-859a3ba160cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Flow 'volume_create_manager' (034bec52-bb6f-49f0-a4e9-061daf0e927d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:16:53 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=71,cinder:SELECT=83,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:16:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-c6b0f9e7-bf66-4dc0-b6b9-8f3c424e7fb6 req-0ef37158-cdab-47df-8e19-37b48eb50736 tempest-VolumesGetTestJSON-2090949915 None] Created volume successfully. Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-056877aa-d39d-4f12-a9fb-32260ca3e5f0 req-f3b59bf7-2ea2-4996-8e18-6d07a2a01f95 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-056877aa-d39d-4f12-a9fb-32260ca3e5f0 req-f3b59bf7-2ea2-4996-8e18-6d07a2a01f95 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-056877aa-d39d-4f12-a9fb-32260ca3e5f0 req-f3b59bf7-2ea2-4996-8e18-6d07a2a01f95 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-056877aa-d39d-4f12-a9fb-32260ca3e5f0 req-f3b59bf7-2ea2-4996-8e18-6d07a2a01f95 tempest-AttachVolumeNegativeTest-1878192140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-c5606a83-ad68-4fc4-8230-86a235e73c91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41dfa22d-a24c-48f1-a443-96f5b7a67c88', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:16:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-056877aa-d39d-4f12-a9fb-32260ca3e5f0 req-f3b59bf7-2ea2-4996-8e18-6d07a2a01f95 tempest-AttachVolumeNegativeTest-1878192140 None] attachment_update completed successfully. Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Acquiring lock "cinder-eb93c8c1-ecd0-4d56-9da5-72f90e889db1-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Lock "cinder-eb93c8c1-ecd0-4d56-9da5-72f90e889db1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Acquiring lock "cinder-quobyte-eb93c8c1-ecd0-4d56-9da5-72f90e889db1" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Lock "cinder-quobyte-eb93c8c1-ecd0-4d56-9da5-72f90e889db1" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da28a52-d484-469a-b36d-553753b10afa]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:16:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:54 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 Sep 25 16:16:54 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:55 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1" returned: 0 in 0.617s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:55 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1 Sep 25 16:16:55 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:55 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-eb93c8c1-ecd0-4d56-9da5-72f90e889db1" returned: 0 in 0.415s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Lock "cinder-quobyte-eb93c8c1-ecd0-4d56-9da5-72f90e889db1" released by "delete_volume" :: held 1.102s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:55 devstack cinder-volume[87467]: DEBUG cinder.quota [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Created reservations ['caea7c2f-0fde-4ada-b578-d7e243c613b4', 'e9df3513-581e-463e-8ff9-39e167d3a9a2', 'a6b79007-00da-4dfb-aff6-3e80241a0cb7', '3d95e85d-8c51-4efe-a66d-3bf496c0fbd2'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:16:56 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:16:56 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:16:56 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.564s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG cinder.manager [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:16:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Deleted volume successfully. Sep 25 16:16:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-ac1042b7-5c0e-429d-a830-e0e13553cea2 req-bc4cc28e-5050-4aba-81de-d22088bea929 tempest-VolumesGetTestJSON-2090949915 None] Lock "cinder-eb93c8c1-ecd0-4d56-9da5-72f90e889db1-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:16:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-1502e0f9-10f7-4a5b-874e-50f4c13d2ac3 req-1ea2053b-61a3-4947-bb44-840e0a32bdc6 tempest-AttachVolumeNegativeTest-1878192140 None] Terminate volume connection completed successfully. Sep 25 16:16:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-1502e0f9-10f7-4a5b-874e-50f4c13d2ac3 req-1ea2053b-61a3-4947-bb44-840e0a32bdc6 tempest-AttachVolumeNegativeTest-1878192140 None] Deleting attachment 41dfa22d-a24c-48f1-a443-96f5b7a67c88. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:17:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a85dbc32-dc10-41e0-84bc-ae2f73efab4a tempest-BackendsCapabilitiesAdminTestsJSON-445424520 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3218307495117, 'free_capacity_gb': 1775.3218307495117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87467) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:17:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-58517e6d-bd2b-48a0-afb2-6de89ec5c49f tempest-BackendsCapabilitiesAdminTestsJSON-445424520 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3218307495117, 'free_capacity_gb': 1775.3218307495117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87467) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:17:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "cinder-c5606a83-ad68-4fc4-8230-86a235e73c91-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-c5606a83-ad68-4fc4-8230-86a235e73c91-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "cinder-quobyte-c5606a83-ad68-4fc4-8230-86a235e73c91" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-quobyte-c5606a83-ad68-4fc4-8230-86a235e73c91" acquired by "delete_volume" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cc0dbd-63a8-4880-8893-a69f4477673c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:07 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 Sep 25 16:17:07 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:08 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91" returned: 0 in 0.756s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:08 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91 Sep 25 16:17:08 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:09 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c5606a83-ad68-4fc4-8230-86a235e73c91" returned: 0 in 0.831s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-quobyte-c5606a83-ad68-4fc4-8230-86a235e73c91" released by "delete_volume" :: held 1.693s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Created reservations ['c1cf26b7-60ff-4fcb-b979-844ede1f2005', '31f7685c-1f31-4663-8954-c43bbe29bec0', '92cbc2b5-09d4-4850-9054-f401b5bf9ff1', '6a6ecba0-c9c0-47ad-8689-1b206a4b5790'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:09 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:17:09 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:10 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.390s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:10 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Deleted volume successfully. Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4706c9df-64eb-4794-9d75-1ee0d77dfa3d tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-c5606a83-ad68-4fc4-8230-86a235e73c91-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "cinder-57b53bc0-99f0-4376-bcdb-ca8d87310efb-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-57b53bc0-99f0-4376-bcdb-ca8d87310efb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "cinder-quobyte-57b53bc0-99f0-4376-bcdb-ca8d87310efb" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-quobyte-57b53bc0-99f0-4376-bcdb-ca8d87310efb" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2388a5-5bf9-4294-b807-daaa0bfb3d19]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:10 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb Sep 25 16:17:10 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:11 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb" returned: 0 in 0.682s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:11 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb Sep 25 16:17:11 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:11 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57b53bc0-99f0-4376-bcdb-ca8d87310efb" returned: 0 in 0.463s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-quobyte-57b53bc0-99f0-4376-bcdb-ca8d87310efb" released by "delete_volume" :: held 1.227s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Created reservations ['7519e8a8-2748-4919-af80-8c2fd99dd027', '61dd94d4-a550-4474-bd88-177aa11d693f', 'c530f592-2be4-4984-b153-eed1372fd2ad', '6b0aeae5-b32c-442d-a5f5-c6b99836571e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:12 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:17:12 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:12 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.417s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:12 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:12 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Deleted volume successfully. Sep 25 16:17:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65bb9b34-6c52-442e-b6de-f41b8e19d301 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-57b53bc0-99f0-4376-bcdb-ca8d87310efb-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "cinder-30157b4c-518e-45c7-bdde-d9d04f7af581-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-30157b4c-518e-45c7-bdde-d9d04f7af581-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "cinder-quobyte-30157b4c-518e-45c7-bdde-d9d04f7af581" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-quobyte-30157b4c-518e-45c7-bdde-d9d04f7af581" acquired by "delete_volume" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:13 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53698cc-42a0-4486-8bd8-fd686d7b12c9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:13 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 Sep 25 16:17:13 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:14 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581" returned: 0 in 0.518s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:14 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581 Sep 25 16:17:14 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:14 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30157b4c-518e-45c7-bdde-d9d04f7af581" returned: 0 in 0.377s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-quobyte-30157b4c-518e-45c7-bdde-d9d04f7af581" released by "delete_volume" :: held 1.004s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Created reservations ['1d86d7d9-c0b1-4d55-a1eb-427fff74cad4', '361cca2b-3df5-4861-bb9b-b70a669e7086', '94899d39-d8a6-4750-a7ee-f277073c8930', '1d2df129-d5a1-410b-8efb-9774f9ea74a1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:14 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:17:14 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:15 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.361s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:15 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Deleted volume successfully. Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eb5dd9d6-93f9-4996-8144-bf71df6c3092 tempest-AttachVolumeNegativeTest-1878192140 None] Lock "cinder-30157b4c-518e-45c7-bdde-d9d04f7af581-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:15 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:17:15 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:15 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.571s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:17:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:17:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:17:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f27fdbef-ecea-478b-b3bf-efcefd0512ee tempest-GroupSnapshotsV319Test-1352907102 None] Group tempest-GroupSnapshotsV319Test-Group-23617640: creating Sep 25 16:17:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f27fdbef-ecea-478b-b3bf-efcefd0512ee tempest-GroupSnapshotsV319Test-1352907102 None] Group tempest-GroupSnapshotsV319Test-Group-23617640: created successfully Sep 25 16:17:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f27fdbef-ecea-478b-b3bf-efcefd0512ee tempest-GroupSnapshotsV319Test-1352907102 None] Create group completed successfully. Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Flow 'volume_create_manager' (fa371ee8-6e05-4648-abca-5932b3b036ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211bece8-2d26-42d5-becc-fadcd994e717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211bece8-2d26-42d5-becc-fadcd994e717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754898792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad9643e4-8e61-41e0-9fba-6fe6e0807972,host='devstack@QuobyteHD#QuobyteHD',id=86be86e7-8423-415e-811a-526fdff54645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a392d545f7d841a6a7b03f614ec0c09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:20Z,use_quota=True,user_id='3911252a2ba541b99e110d8b2640de6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77aca52d-7656-4e2e-a32d-29ae8702ec8d),volume_type_id=77aca52d-7656-4e2e-a32d-29ae8702ec8d)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72afedce-8c70-4b5a-9841-0c815762977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72afedce-8c70-4b5a-9841-0c815762977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7009589a-44be-4861-8338-54ec4bf01e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7009589a-44be-4861-8338-54ec4bf01e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86be86e7-8423-415e-811a-526fdff54645', 'volume_name': 'volume-86be86e7-8423-415e-811a-526fdff54645', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aef9ab-f2b5-4156-8938-8ad709b13ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aef9ab-f2b5-4156-8938-8ad709b13ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf3228a-9d9d-4ad9-924e-6b91f50972ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Volume 86be86e7-8423-415e-811a-526fdff54645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86be86e7-8423-415e-811a-526fdff54645', 'volume_size': 1} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ad9643e4-8e61-41e0-9fba-6fe6e0807972,created_at=2026-09-25T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754898792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad9643e4-8e61-41e0-9fba-6fe6e0807972,host='devstack@QuobyteHD#QuobyteHD',id=86be86e7-8423-415e-811a-526fdff54645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a392d545f7d841a6a7b03f614ec0c09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:20Z,use_quota=True,user_id='3911252a2ba541b99e110d8b2640de6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77aca52d-7656-4e2e-a32d-29ae8702ec8d),volume_type_id=77aca52d-7656-4e2e-a32d-29ae8702ec8d)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Creating volume 86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:20 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:20 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 1073741824 Sep 25 16:17:20 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:20 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 1073741824" returned: 0 in 0.646s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:20 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 Sep 25 16:17:20 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:21 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645" returned: 0 in 0.505s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf3228a-9d9d-4ad9-924e-6b91f50972ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86be86e7-8423-415e-811a-526fdff54645', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1781b45-92f3-4d22-9bd7-3614c8841bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Volume volume-86be86e7-8423-415e-811a-526fdff54645 (86be86e7-8423-415e-811a-526fdff54645): created successfully Sep 25 16:17:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1781b45-92f3-4d22-9bd7-3614c8841bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Flow 'volume_create_manager' (fa371ee8-6e05-4648-abca-5932b3b036ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-13b3157f-4a88-4cd1-a80f-613d2a7c43bd tempest-GroupSnapshotsV319Test-1352907102 None] Created volume successfully. Sep 25 16:17:22 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] GroupSnapshot 36e34349-598c-4468-b94a-c075d3bc87e5: creating. Sep 25 16:17:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Group snapshot 36e34349-598c-4468-b94a-c075d3bc87e5: creating. {{(pid=87467) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:17:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Creating offline snapshot 5a1de5ca-e955-4113-b335-91fa7d74cdd9 of volume 86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:17:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[98709f78-4ee3-4f61-a9ea-7a981023d6fd]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:23 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 Sep 25 16:17:23 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:23 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645" returned: 0 in 0.490s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:23 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 1G Sep 25 16:17:23 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:24 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 1G" returned: 0 in 0.648s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86be86e7-8423-415e-811a-526fdff54645 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:24 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86be86e7-8423-415e-811a-526fdff54645 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 Sep 25 16:17:24 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:24 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86be86e7-8423-415e-811a-526fdff54645 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9" returned: 0 in 0.368s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:24 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:17:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:24 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 Sep 25 16:17:24 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:24 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9" returned: 0 in 0.287s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:24 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.info Sep 25 16:17:24 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:25 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.info" returned: 0 in 0.499s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:25 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:17:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:25 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.info Sep 25 16:17:25 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:25 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.info" returned: 0 in 0.342s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4abccdcc-bff7-47fe-a1ab-149dc44eb969 tempest-GroupSnapshotsV319Test-1352907102 None] group_snapshot 36e34349-598c-4468-b94a-c075d3bc87e5: created successfully Sep 25 16:17:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] group_snapshot 36e34349-598c-4468-b94a-c075d3bc87e5: deleting Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] group_snapshot 36e34349-598c-4468-b94a-c075d3bc87e5: deleting {{(pid=87467) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Acquiring lock "cinder-quobyte-86be86e7-8423-415e-811a-526fdff54645" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Lock "cinder-quobyte-86be86e7-8423-415e-811a-526fdff54645" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Acquiring lock "cinder-quobyte-5a1de5ca-e955-4113-b335-91fa7d74cdd9" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Lock "cinder-quobyte-5a1de5ca-e955-4113-b335-91fa7d74cdd9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Deleting offline snapshot 5a1de5ca-e955-4113-b335-91fa7d74cdd9 of volume 86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] snapshot_file for this snap is: volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f081f5-c7d6-48c7-8170-8963ec73aa15]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:27 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 Sep 25 16:17:27 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:27 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9" returned: 0 in 0.626s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86be86e7-8423-415e-811a-526fdff54645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:27 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c28157-d5db-4ea7-9e28-9584ca772640]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:27 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 Sep 25 16:17:27 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:28 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645" returned: 0 in 0.824s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:28 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 Sep 25 16:17:28 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:28 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9" returned: 0 in 0.477s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:28 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9 Sep 25 16:17:28 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:29 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645.5a1de5ca-e955-4113-b335-91fa7d74cdd9" returned: 0 in 0.366s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Lock "cinder-quobyte-5a1de5ca-e955-4113-b335-91fa7d74cdd9" released by "_delete_snapshot" :: held 2.513s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Lock "cinder-quobyte-86be86e7-8423-415e-811a-526fdff54645" released by "delete_snapshot" :: held 2.549s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:29 devstack cinder-volume[87467]: WARNING cinder.quota [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-589461927 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-589461927, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:17:29 devstack cinder-volume[87467]: WARNING cinder.quota [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-589461927 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-589461927, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:17:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] Created reservations ['17f02e5e-3a7f-428d-b82a-7d9022c52ab5', '903920f4-be62-4ced-b804-b1c4d19b8605', '0de17838-5391-41be-9404-6e74a5d241c8', 'efe416d5-a5a5-4151-8074-a090b6e55915'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d46a953d-cbd0-4157-8b54-dfb39de053af tempest-GroupSnapshotsV319Test-1352907102 None] group_snapshot 36e34349-598c-4468-b94a-c075d3bc87e5: deleted successfully Sep 25 16:17:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Acquiring lock "cinder-quobyte-86be86e7-8423-415e-811a-526fdff54645" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Lock "cinder-quobyte-86be86e7-8423-415e-811a-526fdff54645" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3315de-dad2-49d2-a394-0152e3723c2c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:31 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 Sep 25 16:17:31 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:31 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645" returned: 0 in 0.584s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:31 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645 Sep 25 16:17:31 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:31 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-86be86e7-8423-415e-811a-526fdff54645" returned: 0 in 0.293s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Lock "cinder-quobyte-86be86e7-8423-415e-811a-526fdff54645" released by "delete_volume" :: held 1.006s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:31 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Created reservations ['2770bac2-7268-4659-aebe-64c111d46c31'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:31 devstack cinder-volume[87467]: WARNING cinder.quota [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-589461927 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-589461927, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Created reservations ['b3c6e421-1fb3-4141-887f-397529ca5a3c', 'ee5d4bfd-4e52-4473-a5f6-86374ad24a5a', '648297b7-7269-418c-bc52-632cbb856ee8', 'd236875a-6e84-440e-8a16-d75a103cd704'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:32 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:17:32 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:32 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.357s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:32 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:32 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3860a904-0e7a-4090-a2bd-2067b7ed2e88 tempest-GroupSnapshotsV319Test-1352907102 None] Delete group completed successfully. Sep 25 16:17:40 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-aa9f1460-7abd-4474-a46c-dc0edb0cc738 tempest-TestShelveInstance-233553811 None] Terminate volume connection completed successfully. Sep 25 16:17:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-aa9f1460-7abd-4474-a46c-dc0edb0cc738 tempest-TestShelveInstance-233553811 None] Deleting attachment f7436296-a139-4245-a0d4-22694311a61d. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:17:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Acquiring lock "cinder-985ac402-6f54-438e-9eb9-7bbfb5ebf49f-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Lock "cinder-985ac402-6f54-438e-9eb9-7bbfb5ebf49f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Acquiring lock "cinder-quobyte-985ac402-6f54-438e-9eb9-7bbfb5ebf49f" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Lock "cinder-quobyte-985ac402-6f54-438e-9eb9-7bbfb5ebf49f" acquired by "delete_volume" :: waited 0.049s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:41 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c91e540-7169-403e-ba0d-36328124b59d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-76c3b3c1-08ff-4f19-80d3-6b28c1cbeea7 tempest-GroupSnapshotsTest-788422569 None] Group tempest-GroupSnapshotsTest-Group-1446175782: creating Sep 25 16:17:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-76c3b3c1-08ff-4f19-80d3-6b28c1cbeea7 tempest-GroupSnapshotsTest-788422569 None] Group tempest-GroupSnapshotsTest-Group-1446175782: created successfully Sep 25 16:17:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-76c3b3c1-08ff-4f19-80d3-6b28c1cbeea7 tempest-GroupSnapshotsTest-788422569 None] Create group completed successfully. Sep 25 16:17:41 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f Sep 25 16:17:41 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:41 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f" returned: 0 in 0.720s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:41 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f Sep 25 16:17:41 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:42 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-985ac402-6f54-438e-9eb9-7bbfb5ebf49f" returned: 0 in 0.538s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Lock "cinder-quobyte-985ac402-6f54-438e-9eb9-7bbfb5ebf49f" released by "delete_volume" :: held 1.384s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG cinder.quota [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Created reservations ['a873be29-31d8-4e1d-a97a-d3138d1d53a9', '03b61be3-3841-4d5c-84a4-019850440db1', '732c9668-adde-4782-8346-24c502dffd9f', '603a00fe-5ad0-423a-85dc-424459b0dba9'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:42 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:17:42 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:43 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.452s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.manager [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:17:43 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Deleted volume successfully. Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [req-92941577-d4f2-4ebb-92d9-dbe5ac8d8f44 req-7ca4722a-14be-4af5-9837-bc22548b4b7b tempest-TestShelveInstance-233553811 None] Lock "cinder-985ac402-6f54-438e-9eb9-7bbfb5ebf49f-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (582a2143-c708-4479-b2a6-7fcf9aa3f910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2888a99a-6287-4035-85b4-1a705ef7c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2888a99a-6287-4035-85b4-1a705ef7c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167783827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13bdf769-6cde-4bf9-ac36-d5b073e18e68,host='devstack@QuobyteHD#QuobyteHD',id=3b93feec-b83a-4223-957d-9bc8f5d1b61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:43Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e8c210-368b-4f60-aa80-21674991d37c),volume_type_id=50e8c210-368b-4f60-aa80-21674991d37c)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0efefde-78cb-49ff-afe0-250ecd25957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0efefde-78cb-49ff-afe0-250ecd25957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011c7d96-932e-4886-8516-a524f86c70d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011c7d96-932e-4886-8516-a524f86c70d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b93feec-b83a-4223-957d-9bc8f5d1b61a', 'volume_name': 'volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83164c3-cee2-4baa-a1c3-a87fe65755a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83164c3-cee2-4baa-a1c3-a87fe65755a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4eae367-047e-47d7-a6c3-c7f91280b534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Volume 3b93feec-b83a-4223-957d-9bc8f5d1b61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a', 'volume_size': 1} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13bdf769-6cde-4bf9-ac36-d5b073e18e68,created_at=2026-09-25T14:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167783827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13bdf769-6cde-4bf9-ac36-d5b073e18e68,host='devstack@QuobyteHD#QuobyteHD',id=3b93feec-b83a-4223-957d-9bc8f5d1b61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:17:43Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e8c210-368b-4f60-aa80-21674991d37c),volume_type_id=50e8c210-368b-4f60-aa80-21674991d37c)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Creating volume 3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:43 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:17:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:43 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a 1073741824 Sep 25 16:17:43 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:44 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a 1073741824" returned: 0 in 0.818s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:44 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a Sep 25 16:17:44 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:44 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a" returned: 0 in 0.502s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4eae367-047e-47d7-a6c3-c7f91280b534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a38c1f-1305-40ef-a6d1-bd04963b5dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:17:44 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Volume volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a (3b93feec-b83a-4223-957d-9bc8f5d1b61a): created successfully Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a38c1f-1305-40ef-a6d1-bd04963b5dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:17:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (582a2143-c708-4479-b2a6-7fcf9aa3f910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:17:45 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e82eca74-29ac-4244-8a18-025a9fb374bf tempest-GroupSnapshotsTest-788422569 None] Created volume successfully. Sep 25 16:17:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] GroupSnapshot 2b7279d1-8323-4b3a-824f-fa926e850719: creating. Sep 25 16:17:46 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Group snapshot 2b7279d1-8323-4b3a-824f-fa926e850719: creating. {{(pid=87467) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:17:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Creating offline snapshot f7b79fb9-b372-4ead-9ae9-417ba6180e8c of volume 3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:17:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecb0a93-7b02-479e-98b5-758c34e52027]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:47 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a Sep 25 16:17:47 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:47 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a" returned: 0 in 0.718s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:47 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c 1G Sep 25 16:17:47 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:48 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c 1G" returned: 0 in 0.927s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:48 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c Sep 25 16:17:48 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:49 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c" returned: 0 in 0.560s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:49 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:17:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:49 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c Sep 25 16:17:49 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:49 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c" returned: 0 in 0.550s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:49 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.info Sep 25 16:17:49 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:50 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.info" returned: 0 in 0.415s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:50 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:17:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:50 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.info Sep 25 16:17:50 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:50 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.info" returned: 0 in 0.310s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.665s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-da6bccd0-454e-40a0-a52e-4d5dd1f15132 tempest-GroupSnapshotsTest-788422569 None] group_snapshot 2b7279d1-8323-4b3a-824f-fa926e850719: created successfully Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-f7b79fb9-b372-4ead-9ae9-417ba6180e8c-0e0c9a50-2173-4689-bdb3-80496d50be96" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-f7b79fb9-b372-4ead-9ae9-417ba6180e8c-0e0c9a50-2173-4689-bdb3-80496d50be96" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Creating volume 0e0c9a50-2173-4689-bdb3-80496d50be96 from snapshot f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:17:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-0e0c9a50-2173-4689-bdb3-80496d50be96" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-0e0c9a50-2173-4689-bdb3-80496d50be96" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] snapshot: f7b79fb9-b372-4ead-9ae9-417ba6180e8c, volume: 0e0c9a50-2173-4689-bdb3-80496d50be96, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8852f9e8-4e89-4188-982a-c4267d7c03f7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:53 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c Sep 25 16:17:53 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:53 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c" returned: 0 in 0.645s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dedbf6c-7d5b-4894-bc8d-f90f0a06cbe3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:17:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:54 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a Sep 25 16:17:54 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:17:54 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 25 16:17:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a" returned: 0 in 0.737s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:17:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:17:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:17:54 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:17:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:17:54 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 Sep 25 16:17:54 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:02 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=68,cinder:UPDATE=66,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:18:03 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:DELETE=4,cinder:SELECT=73,cinder:INSERT=14,cinder:UPDATE=76 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:18:06 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96" returned: 0 in 11.450s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:06 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a, size 1024.00 MB, duration 11.45 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:18:06 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Converted 1024.00 MB image at 89.42 MB/s Sep 25 16:18:06 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:18:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:06 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 Sep 25 16:18:06 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:06 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96" returned: 0 in 0.852s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-0e0c9a50-2173-4689-bdb3-80496d50be96" released by "_copy_volume_from_snapshot" :: held 13.898s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-f7b79fb9-b372-4ead-9ae9-417ba6180e8c-0e0c9a50-2173-4689-bdb3-80496d50be96" released by "_create_volume_from_snapshot" :: held 14.108s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.179s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Flow 'volume_create_manager' (c13cd5b8-86a4-4aba-b7ec-404b6d46637f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2b49f3-ed3c-4e14-b1df-03c539840566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2b49f3-ed3c-4e14-b1df-03c539840566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-277100554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a22ed37-e26d-4113-aa93-f4a6ef6c53b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081d646fd2e049a98db571cd5f2575c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:07Z,use_quota=True,user_id='c3d47b25ae0a418c962056d2ebe4b723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22be8a10-a2c7-4e4b-b681-43812c93b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22be8a10-a2c7-4e4b-b681-43812c93b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a28a171-3564-4b3f-9516-58c67960381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a28a171-3564-4b3f-9516-58c67960381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a22ed37-e26d-4113-aa93-f4a6ef6c53b7', 'volume_name': 'volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5161f5bb-68b2-4a70-8a59-ef7b47920f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5161f5bb-68b2-4a70-8a59-ef7b47920f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d6deda-e1a7-4fe7-b759-febaee6f7b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:07 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Volume 1a22ed37-e26d-4113-aa93-f4a6ef6c53b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7', 'volume_size': 1} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-277100554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a22ed37-e26d-4113-aa93-f4a6ef6c53b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081d646fd2e049a98db571cd5f2575c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:07Z,use_quota=True,user_id='c3d47b25ae0a418c962056d2ebe4b723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Creating volume 1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:07 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:18:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:07 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 1073741824 Sep 25 16:18:07 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:07 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-251636aa-9938-40d2-9b30-6b17b9241e2e tempest-GroupSnapshotsTest-788422569 None] Create group from source-snapshot-2b7279d1-8323-4b3a-824f-fa926e850719 completed successfully. Sep 25 16:18:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-0e0c9a50-2173-4689-bdb3-80496d50be96" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:08 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-0e0c9a50-2173-4689-bdb3-80496d50be96" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 1073741824" returned: 0 in 1.088s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:08 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56fe99f-e151-466a-bf4c-555353808d24]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:08 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 Sep 25 16:18:08 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:08 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 Sep 25 16:18:08 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:09 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7" returned: 0 in 0.646s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:09 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96" returned: 0 in 0.742s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d6deda-e1a7-4fe7-b759-febaee6f7b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:09 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96 Sep 25 16:18:09 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118fdcbb-f035-4e48-9f77-ed26ecc39991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:09 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Volume volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 (1a22ed37-e26d-4113-aa93-f4a6ef6c53b7): created successfully Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118fdcbb-f035-4e48-9f77-ed26ecc39991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Flow 'volume_create_manager' (c13cd5b8-86a4-4aba-b7ec-404b6d46637f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:09 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-047c2adb-e348-4dd9-98dc-c034d6da9e16 tempest-TestMinimumBasicScenario-1417941848 None] Created volume successfully. Sep 25 16:18:09 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0e0c9a50-2173-4689-bdb3-80496d50be96" returned: 0 in 0.446s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-0e0c9a50-2173-4689-bdb3-80496d50be96" released by "delete_volume" :: held 1.277s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['1abc2b4c-b4f0-4f2a-b429-8eb45b3f9679'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:10 devstack cinder-volume[87467]: WARNING cinder.quota [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1355456666 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1355456666, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:10 devstack cinder-volume[87467]: WARNING cinder.quota [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1355456666 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1355456666, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['00c5af1c-5bd0-4c01-b03f-89089397d5e9', '71eb7a4d-6851-40a7-b96a-39523153275b', '48f6cca0-32e9-4200-8ba2-25cee2d729fc', '382e481c-f5ba-4455-9985-d56ec57e8605'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:10 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:18:10 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:10 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.500s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-dd659045-f06b-4246-9dee-bc19e5ca0b57 tempest-GroupSnapshotsTest-788422569 None] Delete group completed successfully. Sep 25 16:18:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] group_snapshot 2b7279d1-8323-4b3a-824f-fa926e850719: deleting Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] group_snapshot 2b7279d1-8323-4b3a-824f-fa926e850719: deleting {{(pid=87467) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-3b93feec-b83a-4223-957d-9bc8f5d1b61a" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-3b93feec-b83a-4223-957d-9bc8f5d1b61a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-f7b79fb9-b372-4ead-9ae9-417ba6180e8c" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-f7b79fb9-b372-4ead-9ae9-417ba6180e8c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Deleting offline snapshot f7b79fb9-b372-4ead-9ae9-417ba6180e8c of volume 3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] snapshot_file for this snap is: volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba8cd10-4297-47f6-8edc-d75e8fdd6ea0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:12 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c Sep 25 16:18:12 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:12 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c" returned: 0 in 0.726s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d68fbea-6a37-46bc-ac0c-404cbc96ba80]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:12 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a Sep 25 16:18:12 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-82853273-bcb4-40a1-98cd-8c3e32c393db req-520cefe0-5ca5-4426-8869-170c803e79ff tempest-TestMinimumBasicScenario-1417941848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-82853273-bcb4-40a1-98cd-8c3e32c393db req-520cefe0-5ca5-4426-8869-170c803e79ff tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-82853273-bcb4-40a1-98cd-8c3e32c393db req-520cefe0-5ca5-4426-8869-170c803e79ff tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-82853273-bcb4-40a1-98cd-8c3e32c393db req-520cefe0-5ca5-4426-8869-170c803e79ff tempest-TestMinimumBasicScenario-1417941848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbb039c1-4fb5-4c0a-9963-606203ec5d1d', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:18:13 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-82853273-bcb4-40a1-98cd-8c3e32c393db req-520cefe0-5ca5-4426-8869-170c803e79ff tempest-TestMinimumBasicScenario-1417941848 None] attachment_update completed successfully. Sep 25 16:18:13 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a" returned: 0 in 0.805s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:13 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c Sep 25 16:18:13 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:14 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c" returned: 0 in 0.668s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:14 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c Sep 25 16:18:14 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:14 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a.f7b79fb9-b372-4ead-9ae9-417ba6180e8c" returned: 0 in 0.511s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-f7b79fb9-b372-4ead-9ae9-417ba6180e8c" released by "_delete_snapshot" :: held 2.903s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-3b93feec-b83a-4223-957d-9bc8f5d1b61a" released by "delete_snapshot" :: held 2.936s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:14 devstack cinder-volume[87467]: WARNING cinder.quota [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1355456666 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1355456666, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:14 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] Created reservations ['b615ad0d-bce5-4bdf-8e48-4c065f2168da', '7c7c6ce6-8934-43b9-b301-26f2a0a4f781', '4b9e259f-79d7-4989-8df4-ef52bcccb848', 'e3007c8e-2610-4b2a-bcd4-3c6b8a778604'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:15 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-56a7d599-2fb6-4fd6-a9f5-a7e7fc9cfd9e tempest-GroupSnapshotsTest-788422569 None] group_snapshot 2b7279d1-8323-4b3a-824f-fa926e850719: deleted successfully Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:15 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:18:15 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-3b93feec-b83a-4223-957d-9bc8f5d1b61a" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-3b93feec-b83a-4223-957d-9bc8f5d1b61a" acquired by "delete_volume" :: waited 0.046s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46955d42-abb9-47b1-b9f0-9fe8770c3548]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:15 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.529s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:18:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:18:16 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a Sep 25 16:18:16 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:16 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a" returned: 0 in 0.642s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:16 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a Sep 25 16:18:16 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:16 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3b93feec-b83a-4223-957d-9bc8f5d1b61a" returned: 0 in 0.346s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:16 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-3b93feec-b83a-4223-957d-9bc8f5d1b61a" released by "delete_volume" :: held 1.153s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:16 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['6ac3b15d-5ff0-452d-95a0-0f15a0f17f26'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:16 devstack cinder-volume[87467]: WARNING cinder.db.api [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1355456666'] Sep 25 16:18:16 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['4bb42c66-f544-4d57-8cd2-e5953e8422ee', 'c694a8f7-bf03-4dbf-a407-5659cd1bc0c1', '60c2dbc3-64c0-4215-baaa-f0e08c6acba4', 'c278e3f2-ad33-4a54-9444-cc42e43f6020'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:17 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:18:17 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:17 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.483s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:17 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d9c07bc9-a68b-42ed-bea0-b86cd9dc6d72 tempest-GroupSnapshotsTest-788422569 None] Delete group completed successfully. Sep 25 16:18:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7bd6e5b9-34e7-4b94-bb92-05d247eb3157 tempest-GroupSnapshotsTest-788422569 None] Group tempest-GroupSnapshotsTest-Group-1115792758: creating Sep 25 16:18:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7bd6e5b9-34e7-4b94-bb92-05d247eb3157 tempest-GroupSnapshotsTest-788422569 None] Group tempest-GroupSnapshotsTest-Group-1115792758: created successfully Sep 25 16:18:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7bd6e5b9-34e7-4b94-bb92-05d247eb3157 tempest-GroupSnapshotsTest-788422569 None] Create group completed successfully. Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (aa9a126d-006e-4995-836c-82565095271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf13fc66-09e2-491c-85f7-3320242986b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf13fc66-09e2-491c-85f7-3320242986b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546426108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e326056-6430-4440-b8d3-1f8bd2091eb3,host='devstack@QuobyteHD#QuobyteHD',id=a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:21Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00bdc89c-46b2-4b91-bc09-1cc3112a032c),volume_type_id=00bdc89c-46b2-4b91-bc09-1cc3112a032c)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d179133d-15c3-4508-94a3-08ba4e3e1405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d179133d-15c3-4508-94a3-08ba4e3e1405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411d4af5-6fd4-4e4e-ac85-dc9e0a8401b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411d4af5-6fd4-4e4e-ac85-dc9e0a8401b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b', 'volume_name': 'volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00642a17-4379-4ed2-a0bd-38d66ee0a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00642a17-4379-4ed2-a0bd-38d66ee0a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe763cda-fa4e-4804-9b7d-82d5e3026243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Volume a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b', 'volume_size': 1} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e326056-6430-4440-b8d3-1f8bd2091eb3,created_at=2026-09-25T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546426108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e326056-6430-4440-b8d3-1f8bd2091eb3,host='devstack@QuobyteHD#QuobyteHD',id=a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:21Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00bdc89c-46b2-4b91-bc09-1cc3112a032c),volume_type_id=00bdc89c-46b2-4b91-bc09-1cc3112a032c)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Creating volume a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:21 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:21 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b 1073741824 Sep 25 16:18:21 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:21 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b 1073741824" returned: 0 in 0.634s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:21 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b Sep 25 16:18:21 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:22 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" returned: 0 in 0.618s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe763cda-fa4e-4804-9b7d-82d5e3026243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bf85ba-87e6-405c-838c-9f28905b339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:22 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Volume volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b (a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b): created successfully Sep 25 16:18:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bf85ba-87e6-405c-838c-9f28905b339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (aa9a126d-006e-4995-836c-82565095271c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:22 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2dcecae4-a9b4-4778-9716-d20856225579 tempest-GroupSnapshotsTest-788422569 None] Created volume successfully. Sep 25 16:18:24 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (82c39813-1c36-41cd-bf6f-34b8270b0723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce31a97-14a0-419c-868d-0d6a50004f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce31a97-14a0-419c-868d-0d6a50004f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027409487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e326056-6430-4440-b8d3-1f8bd2091eb3,host='devstack@QuobyteHD#QuobyteHD',id=05b7bc35-a5e6-44d8-a4c1-ea4be195a677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:25Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00bdc89c-46b2-4b91-bc09-1cc3112a032c),volume_type_id=00bdc89c-46b2-4b91-bc09-1cc3112a032c)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c58bfc-f2b4-4ac2-9764-233113e89d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c58bfc-f2b4-4ac2-9764-233113e89d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d091503-5168-4893-b6b8-445d61ff9f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d091503-5168-4893-b6b8-445d61ff9f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b7bc35-a5e6-44d8-a4c1-ea4be195a677', 'volume_name': 'volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dbb139-c9f9-451f-a681-cd6691e0e998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dbb139-c9f9-451f-a681-cd6691e0e998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2d2f4f-4e8f-457f-994d-9a7be7e6b869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Volume 05b7bc35-a5e6-44d8-a4c1-ea4be195a677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677', 'volume_size': 1} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e326056-6430-4440-b8d3-1f8bd2091eb3,created_at=2026-09-25T14:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027409487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e326056-6430-4440-b8d3-1f8bd2091eb3,host='devstack@QuobyteHD#QuobyteHD',id=05b7bc35-a5e6-44d8-a4c1-ea4be195a677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:25Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00bdc89c-46b2-4b91-bc09-1cc3112a032c),volume_type_id=00bdc89c-46b2-4b91-bc09-1cc3112a032c)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Creating volume 05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:25 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:25 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 1073741824 Sep 25 16:18:25 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:25 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 1073741824" returned: 0 in 0.606s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:25 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 Sep 25 16:18:25 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:26 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" returned: 0 in 0.363s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2d2f4f-4e8f-457f-994d-9a7be7e6b869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b8f858-d4ea-47d5-a769-8385f5d60a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:26 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Volume volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 (05b7bc35-a5e6-44d8-a4c1-ea4be195a677): created successfully Sep 25 16:18:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b8f858-d4ea-47d5-a769-8385f5d60a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (82c39813-1c36-41cd-bf6f-34b8270b0723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-72366edb-15bc-4bd3-af29-feee2d188e2a tempest-GroupSnapshotsTest-788422569 None] Created volume successfully. Sep 25 16:18:27 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3f0168e5-4aaf-4497-a33a-f3c8a2357710 tempest-GroupSnapshotsTest-788422569 None] Update group completed successfully. Sep 25 16:18:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-138a477a-5b70-4def-b561-7b6436cc945f tempest-GroupSnapshotsTest-788422569 None] Update group completed successfully. Sep 25 16:18:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7fc21cc7-6f57-47b9-94ac-d58d9f5cd519 tempest-GroupSnapshotsTest-788422569 None] Update group completed successfully. Sep 25 16:18:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7476a2ca-ea8f-4250-99b3-fec1bbc0f1cb tempest-GroupSnapshotsTest-788422569 None] Update group completed successfully. Sep 25 16:18:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] GroupSnapshot 5be78e4f-83dd-4dfd-8162-a6baca49ecd9: creating. Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Group snapshot 5be78e4f-83dd-4dfd-8162-a6baca49ecd9: creating. {{(pid=87467) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Creating offline snapshot 186b9a38-0ba7-4591-957f-3d37cffffcb3 of volume a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c6d36-2040-4ab5-afb2-b47b3aeef5e3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:33 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b Sep 25 16:18:33 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:33 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" returned: 0 in 0.569s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:33 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 1G Sep 25 16:18:33 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:34 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 1G" returned: 0 in 0.659s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:34 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 Sep 25 16:18:34 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:34 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3" returned: 0 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:34 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:18:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:34 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 Sep 25 16:18:34 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:35 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3" returned: 0 in 0.331s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:35 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.info Sep 25 16:18:35 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:35 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.info" returned: 0 in 0.355s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:35 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:35 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.info Sep 25 16:18:35 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:35 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.info" returned: 0 in 0.369s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Creating offline snapshot 91a8ae1d-d929-4c64-8d77-01982b0900c7 of volume 05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8801a791-a024-4dc7-b342-ad1809ab3581]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:36 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 Sep 25 16:18:36 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:36 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" returned: 0 in 0.497s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:36 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 1G Sep 25 16:18:36 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:36 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 1G" returned: 0 in 0.554s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:37 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 Sep 25 16:18:37 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:37 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7" returned: 0 in 0.487s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:37 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:18:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:37 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 Sep 25 16:18:37 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:37 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7" returned: 0 in 0.325s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:37 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.info Sep 25 16:18:37 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:38 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.info" returned: 0 in 0.323s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:38 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:18:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:38 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.info Sep 25 16:18:38 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:38 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.info" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.645s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:38 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-092b5ef9-d067-4c06-b2b9-49457b5d6b90 tempest-GroupSnapshotsTest-788422569 None] group_snapshot 5be78e4f-83dd-4dfd-8162-a6baca49ecd9: created successfully Sep 25 16:18:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] group_snapshot 5be78e4f-83dd-4dfd-8162-a6baca49ecd9: deleting Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] group_snapshot 5be78e4f-83dd-4dfd-8162-a6baca49ecd9: deleting {{(pid=87467) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-186b9a38-0ba7-4591-957f-3d37cffffcb3" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-186b9a38-0ba7-4591-957f-3d37cffffcb3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Deleting offline snapshot 186b9a38-0ba7-4591-957f-3d37cffffcb3 of volume a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] snapshot_file for this snap is: volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ebe33b-9070-4a3c-a87b-119a235e4b7c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:40 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 Sep 25 16:18:40 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:40 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3" returned: 0 in 0.596s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:40 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f3671-dc47-4704-aea9-ee4b2881efbb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:40 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b Sep 25 16:18:40 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:41 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" returned: 0 in 0.578s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:41 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 Sep 25 16:18:41 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:41 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3" returned: 0 in 0.576s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:41 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3 Sep 25 16:18:41 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:42 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b.186b9a38-0ba7-4591-957f-3d37cffffcb3" returned: 0 in 0.337s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-186b9a38-0ba7-4591-957f-3d37cffffcb3" released by "_delete_snapshot" :: held 2.312s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" released by "delete_snapshot" :: held 2.351s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-91a8ae1d-d929-4c64-8d77-01982b0900c7" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-91a8ae1d-d929-4c64-8d77-01982b0900c7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Deleting offline snapshot 91a8ae1d-d929-4c64-8d77-01982b0900c7 of volume 05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] snapshot_file for this snap is: volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8df24-7bcd-435c-955c-d25783b20dd7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:42 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 Sep 25 16:18:42 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:42 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7" returned: 0 in 0.479s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17988bd-4736-4149-98cb-38421fb7e7e8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:43 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 Sep 25 16:18:43 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:43 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" returned: 0 in 0.727s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:43 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 Sep 25 16:18:43 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:44 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7" returned: 0 in 0.516s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:44 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7 Sep 25 16:18:44 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:44 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677.91a8ae1d-d929-4c64-8d77-01982b0900c7" returned: 0 in 0.513s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-91a8ae1d-d929-4c64-8d77-01982b0900c7" released by "_delete_snapshot" :: held 2.422s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" released by "delete_snapshot" :: held 2.462s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:44 devstack cinder-volume[87467]: WARNING cinder.quota [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1838111718 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1838111718, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:44 devstack cinder-volume[87467]: WARNING cinder.quota [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1838111718 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1838111718, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:44 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Created reservations ['1c3c5fac-4761-4858-855e-d8c586ba7e0a', '73d9609f-1d57-44d5-be4d-891213071245', 'a68a3167-4777-4b8d-824e-91f4b50e9395', 'c06bdf68-7c86-4112-ac8b-c25f7577bd4a'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] Created reservations ['1a206690-df4e-40d0-bbd2-6d0f4b4a1bcd', '8700a8f8-c57a-4997-92fd-ccf4e25ff367', '4139929a-48e4-4c42-90ae-c907333e4575', 'a257aedd-4b14-49f3-b2b9-a667416eff61'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:45 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a04bb429-b686-4903-8b37-63ee09abb63e tempest-GroupSnapshotsTest-788422569 None] group_snapshot 5be78e4f-83dd-4dfd-8162-a6baca49ecd9: deleted successfully Sep 25 16:18:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c9c85-6ce1-4eb9-9c3c-3e1c0c840eff]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:47 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 Sep 25 16:18:47 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:47 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" returned: 0 in 0.669s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:47 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677 Sep 25 16:18:47 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:47 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" returned: 0 in 0.317s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-05b7bc35-a5e6-44d8-a4c1-ea4be195a677" released by "delete_volume" :: held 1.146s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56ef74-5476-478a-99b4-0ea983eeffa6]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:47 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b Sep 25 16:18:47 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:48 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" returned: 0 in 0.561s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:48 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b Sep 25 16:18:48 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:48 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" returned: 0 in 0.332s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-a6e3af8b-7979-4ade-a61f-2ec6ae1ecd6b" released by "delete_volume" :: held 0.999s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:18:48 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['d7c4180c-4c22-46fb-b403-20738fed36b0'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:48 devstack cinder-volume[87467]: WARNING cinder.quota [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1838111718 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1838111718, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:18:48 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['a3e103d3-1f07-4288-8fdd-90aa69bad22f', 'cf9f6fed-965e-4178-a5c6-0cf98248ecd0', '4a361417-9078-44e6-b476-0a90f6710093', '84427afa-2227-471d-b999-938af21300d8'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['64c3a18d-3177-41de-8cf5-a56e9ccdc6bc', 'e2401397-bc8b-47f4-afe8-0fb0785779d1', '65541564-abff-4541-a219-04b66e743109', 'a98b3734-665e-4893-9b92-74dfb093af19'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:49 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:18:49 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:49 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.513s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:49 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:18:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-dac3fd6e-dd78-4663-8f02-306aa805d447 tempest-GroupSnapshotsTest-788422569 None] Delete group completed successfully. Sep 25 16:18:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8c682188-4547-4f47-83fa-1c0e29979d8a tempest-GroupSnapshotsTest-788422569 None] Group tempest-GroupSnapshotsTest-Group-1706177196: creating Sep 25 16:18:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8c682188-4547-4f47-83fa-1c0e29979d8a tempest-GroupSnapshotsTest-788422569 None] Group tempest-GroupSnapshotsTest-Group-1706177196: created successfully Sep 25 16:18:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8c682188-4547-4f47-83fa-1c0e29979d8a tempest-GroupSnapshotsTest-788422569 None] Create group completed successfully. Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (cb4a2b4d-6abb-408a-ac5c-45199b89d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b333e2b2-e596-40e8-b817-d506d6753480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b333e2b2-e596-40e8-b817-d506d6753480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1420551123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c962f5f-37ce-40c7-addf-7979600ddaee,host='devstack@QuobyteHD#QuobyteHD',id=d0e50a3b-dc23-450d-9f4c-bcfa35671eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:52Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dada4951-49c9-4b6d-936d-26e19f4d6275),volume_type_id=dada4951-49c9-4b6d-936d-26e19f4d6275)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2025b0-8b8d-475c-bcde-a1e0ae8f3ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2025b0-8b8d-475c-bcde-a1e0ae8f3ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547cfbd9-4313-4369-bd87-527e57414b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547cfbd9-4313-4369-bd87-527e57414b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e50a3b-dc23-450d-9f4c-bcfa35671eee', 'volume_name': 'volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc3a300-22ee-4e66-973c-632b41bd1639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc3a300-22ee-4e66-973c-632b41bd1639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3738992e-c2ee-432e-a051-2f3c78f284de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Volume d0e50a3b-dc23-450d-9f4c-bcfa35671eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee', 'volume_size': 1} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1c962f5f-37ce-40c7-addf-7979600ddaee,created_at=2026-09-25T14:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1420551123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c962f5f-37ce-40c7-addf-7979600ddaee,host='devstack@QuobyteHD#QuobyteHD',id=d0e50a3b-dc23-450d-9f4c-bcfa35671eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb038df716ed41e9991837e8d7b08397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:52Z,use_quota=True,user_id='0f30ced055c94f02b3705ca87fa5dc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dada4951-49c9-4b6d-936d-26e19f4d6275),volume_type_id=dada4951-49c9-4b6d-936d-26e19f4d6275)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Creating volume d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:52 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:18:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:52 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee 1073741824 Sep 25 16:18:52 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:53 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee 1073741824" returned: 0 in 0.759s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:53 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee Sep 25 16:18:53 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:53 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" returned: 0 in 0.413s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3738992e-c2ee-432e-a051-2f3c78f284de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8078669c-8881-4f20-b9bf-26770e5b7b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Volume volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee (d0e50a3b-dc23-450d-9f4c-bcfa35671eee): created successfully Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8078669c-8881-4f20-b9bf-26770e5b7b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Flow 'volume_create_manager' (cb4a2b4d-6abb-408a-ac5c-45199b89d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f3d3825f-3530-483f-8444-8780ff24003c tempest-GroupSnapshotsTest-788422569 None] Created volume successfully. Sep 25 16:18:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] GroupSnapshot d54d8d81-83ea-4aa2-b5ec-8037df547e25: creating. Sep 25 16:18:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Group snapshot d54d8d81-83ea-4aa2-b5ec-8037df547e25: creating. {{(pid=87467) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 16:18:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Creating offline snapshot 446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 of volume d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:18:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e5e7c5-5726-4135-939a-240e39ca6c2d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:18:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:55 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee Sep 25 16:18:55 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Flow 'volume_create_manager' (fdf7916c-116c-421c-bdd5-3f32ec62af71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb099138-7e77-479e-9c41-c99204a574ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb099138-7e77-479e-9c41-c99204a574ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-292607704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26e7b3c-83a1-49f9-a4ad-fc115eb693e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85ed0d9e3bd41cfbe4be771dd0a09a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:56Z,use_quota=True,user_id='18f114cc4a9b46b184eeb1501c3f264b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9c231b-b7f5-4cbf-9ceb-ee7d56aa0a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9c231b-b7f5-4cbf-9ceb-ee7d56aa0a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5594f-012d-430e-a95f-b0e3ed31061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5594f-012d-430e-a95f-b0e3ed31061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26e7b3c-83a1-49f9-a4ad-fc115eb693e0', 'volume_name': 'volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906f3001-cf44-4977-b5a7-335a1a2e15c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906f3001-cf44-4977-b5a7-335a1a2e15c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84874914-e2f4-4ae3-95bf-0cd16d7ca154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:18:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Volume c26e7b3c-83a1-49f9-a4ad-fc115eb693e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0', 'volume_size': 1} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:56 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" returned: 0 in 0.792s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:56 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 1G Sep 25 16:18:56 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:57 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 1G" returned: 0 in 0.752s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:57 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 Sep 25 16:18:57 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:57 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" returned: 0 in 0.586s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:57 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:18:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:57 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 Sep 25 16:18:57 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:58 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" returned: 0 in 0.676s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:58 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.info Sep 25 16:18:58 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:58 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.info" returned: 0 in 0.441s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:58 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 16:18:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:58 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.info Sep 25 16:18:58 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:59 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.info" returned: 0 in 0.779s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.222s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.386s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-292607704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26e7b3c-83a1-49f9-a4ad-fc115eb693e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85ed0d9e3bd41cfbe4be771dd0a09a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:18:56Z,use_quota=True,user_id='18f114cc4a9b46b184eeb1501c3f264b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Creating volume c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:18:59 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:18:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:18:59 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 1073741824 Sep 25 16:18:59 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:18:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-92d68513-10a2-40ae-ab72-2318404c2eaf tempest-GroupSnapshotsTest-788422569 None] group_snapshot d54d8d81-83ea-4aa2-b5ec-8037df547e25: created successfully Sep 25 16:19:00 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 1073741824" returned: 0 in 0.888s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:00 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 Sep 25 16:19:00 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] group_snapshot d54d8d81-83ea-4aa2-b5ec-8037df547e25: deleting Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] group_snapshot d54d8d81-83ea-4aa2-b5ec-8037df547e25: deleting {{(pid=87467) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 16:19:01 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" returned: 0 in 0.746s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84874914-e2f4-4ae3-95bf-0cd16d7ca154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e85671-5ace-43dd-a07d-841573e0770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:01 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Volume volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 (c26e7b3c-83a1-49f9-a4ad-fc115eb693e0): created successfully Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e85671-5ace-43dd-a07d-841573e0770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Flow 'volume_create_manager' (fdf7916c-116c-421c-bdd5-3f32ec62af71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-46d4f135-4fde-47be-b293-d7ef0451d106 tempest-TestStampPattern-1875593839 None] Created volume successfully. Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Deleting offline snapshot 446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 of volume d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] snapshot_file for this snap is: volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ec4c5-1d7d-45a1-8d65-56f735cc300f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:02 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 Sep 25 16:19:02 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:02 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" returned: 0 in 1.149s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:02 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4512166a-3bb0-4f60-a4da-7356208d5d52]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:03 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee Sep 25 16:19:03 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:03 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" returned: 0 in 0.636s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:03 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 Sep 25 16:19:03 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:04 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" returned: 0 in 0.722s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:04 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121 Sep 25 16:19:04 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:04 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee.446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" returned: 0 in 0.697s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-446b7ba9-8a5d-4cdd-b3b7-a4c0e686a121" released by "_delete_snapshot" :: held 3.502s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" released by "delete_snapshot" :: held 3.598s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=97,cinder:UPDATE=86,cinder:INSERT=18,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=93,cinder:UPDATE=92,cinder:DELETE=4,cinder:INSERT=22 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:19:05 devstack cinder-volume[87467]: WARNING cinder.quota [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-766945496 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-766945496, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:19:05 devstack cinder-volume[87467]: WARNING cinder.quota [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-766945496 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-766945496, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:19:05 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['925447be-50d4-43f9-b320-1072f43f110f', 'fca288d9-99ad-4af6-bd50-4588278e389d', '050fa88d-8f4a-454a-b41b-f78634ac6c58', 'b848a21b-d724-4dea-b11e-b732f5401584'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9c36eb93-13e7-4d64-887b-94fcba5adf63 tempest-GroupSnapshotsTest-788422569 None] group_snapshot d54d8d81-83ea-4aa2-b5ec-8037df547e25: deleted successfully Sep 25 16:19:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "cinder-quobyte-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" acquired by "delete_volume" :: waited 0.061s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd58fa-a20d-4b2e-9ab6-32eb72f4e4d9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:07 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee Sep 25 16:19:07 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:07 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" returned: 0 in 0.565s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:07 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee Sep 25 16:19:07 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:08 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" returned: 0 in 0.517s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Lock "cinder-quobyte-d0e50a3b-dc23-450d-9f4c-bcfa35671eee" released by "delete_volume" :: held 1.294s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['264f6065-ce32-476d-8042-a318a7a38e69'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:08 devstack cinder-volume[87467]: WARNING cinder.quota [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-766945496 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-766945496, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Created reservations ['fcc49d5e-91df-433c-99f1-28ac6529d3ee', '0271f882-dd99-4763-906b-006bec7df529', '4a5d703a-383c-4763-be63-c4b7ffdd704d', '95892c7f-77c1-4178-9604-5eca58ad74aa'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:09 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:09 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:09 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.951s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:09 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:09 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-94f0861e-7fb9-47d6-902e-a19af4551e01 tempest-GroupSnapshotsTest-788422569 None] Delete group completed successfully. Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (f281f62b-fa22-4916-93cb-a612f33631a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d30a1a4-4bb7-45d6-b8c8-3e3a9e949b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d30a1a4-4bb7-45d6-b8c8-3e3a9e949b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-262085763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bfd93b-862f-4093-923b-3c0e5c9c3860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:14Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a14370-279c-4162-b249-08261946101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a14370-279c-4162-b249-08261946101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd4966c-e426-4768-88f2-2a7c7f1d240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd4966c-e426-4768-88f2-2a7c7f1d240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7bfd93b-862f-4093-923b-3c0e5c9c3860', 'volume_name': 'volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba814dbb-9377-4f4c-b8cd-f0f54adaf775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba814dbb-9377-4f4c-b8cd-f0f54adaf775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f97b84-5b00-4230-a028-5aeb20e4ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:14 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Volume b7bfd93b-862f-4093-923b-3c0e5c9c3860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860', 'volume_size': 1} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-262085763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bfd93b-862f-4093-923b-3c0e5c9c3860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:14Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Creating volume b7bfd93b-862f-4093-923b-3c0e5c9c3860 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:14 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:19:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:14 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 1073741824 Sep 25 16:19:14 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:19:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:15 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:15 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:16 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 1073741824" returned: 0 in 1.606s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:16 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.904s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:16 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 Sep 25 16:19:16 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:19:16 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860" returned: 0 in 0.726s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] <== create_volume: return (2551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.557s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f97b84-5b00-4230-a028-5aeb20e4ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0a8b91-9b90-4522-8004-82857014079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Volume volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 (b7bfd93b-862f-4093-923b-3c0e5c9c3860): created successfully Sep 25 16:19:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0a8b91-9b90-4522-8004-82857014079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (f281f62b-fa22-4916-93cb-a612f33631a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3456221a-6a19-4be0-a3f7-0b8b7eeef2b0 tempest-VolumesActionsTest-875652822 None] Created volume successfully. Sep 25 16:19:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9364beb7-00a1-4dd5-9b35-be6392974856 tempest-VolumesActionsTest-875652822 None] Acquiring lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860" by "attach_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9364beb7-00a1-4dd5-9b35-be6392974856 tempest-VolumesActionsTest-875652822 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860" acquired by "attach_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9364beb7-00a1-4dd5-9b35-be6392974856 tempest-VolumesActionsTest-875652822 None] Attaching volume b7bfd93b-862f-4093-923b-3c0e5c9c3860 to instance 15d6b950-1af1-4bda-ab3b-3a204c828569 at mountpoint /dev/vdb on host None. Sep 25 16:19:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9364beb7-00a1-4dd5-9b35-be6392974856 tempest-VolumesActionsTest-875652822 None] Attach volume completed successfully. Sep 25 16:19:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9364beb7-00a1-4dd5-9b35-be6392974856 tempest-VolumesActionsTest-875652822 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860" released by "attach_volume" :: held 0.312s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4a1a2ba4-2992-4079-8e96-75a82b3f081f tempest-VolumesActionsTest-262520389 None] Terminate volume connection completed successfully. Sep 25 16:19:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a1a2ba4-2992-4079-8e96-75a82b3f081f tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-detach_volume" by "detach_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a1a2ba4-2992-4079-8e96-75a82b3f081f tempest-VolumesActionsTest-262520389 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4a1a2ba4-2992-4079-8e96-75a82b3f081f tempest-VolumesActionsTest-262520389 None] Detaching volume b7bfd93b-862f-4093-923b-3c0e5c9c3860 from instance 15d6b950-1af1-4bda-ab3b-3a204c828569. Sep 25 16:19:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4a1a2ba4-2992-4079-8e96-75a82b3f081f tempest-VolumesActionsTest-262520389 None] Detach volume completed successfully. Sep 25 16:19:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a1a2ba4-2992-4079-8e96-75a82b3f081f tempest-VolumesActionsTest-262520389 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-detach_volume" released by "detach_volume" :: held 0.256s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-945cdf36-8520-41fa-8dbd-2761201220ce tempest-VolumesActionsTest-875652822 None] Acquiring lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-detach_volume" by "detach_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-945cdf36-8520-41fa-8dbd-2761201220ce tempest-VolumesActionsTest-875652822 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-945cdf36-8520-41fa-8dbd-2761201220ce tempest-VolumesActionsTest-875652822 None] Volume detach called, but volume not attached. Sep 25 16:19:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-945cdf36-8520-41fa-8dbd-2761201220ce tempest-VolumesActionsTest-875652822 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Acquiring lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Acquiring lock "cinder-quobyte-b7bfd93b-862f-4093-923b-3c0e5c9c3860" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Lock "cinder-quobyte-b7bfd93b-862f-4093-923b-3c0e5c9c3860" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9645694d-ca55-4790-8007-1885e43aadcf]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:22 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 Sep 25 16:19:22 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:22 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860" returned: 0 in 0.606s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:22 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860 Sep 25 16:19:22 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:23 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b7bfd93b-862f-4093-923b-3c0e5c9c3860" returned: 0 in 0.573s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Lock "cinder-quobyte-b7bfd93b-862f-4093-923b-3c0e5c9c3860" released by "delete_volume" :: held 1.276s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Created reservations ['54468433-d145-4dc6-9eb9-4fcc01515608', 'c91a266a-9e9f-405c-ba14-262cabfbafeb', 'c21254ed-ba95-40ef-a86d-2082b841d5f1', '5a3cde29-285b-4997-b264-00fb50b3c028'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:23 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:23 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:24 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.575s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:24 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Deleted volume successfully. Sep 25 16:19:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1527b750-7666-48a6-9d7a-3ccb4c0af023 tempest-VolumesActionsTest-875652822 None] Lock "cinder-b7bfd93b-862f-4093-923b-3c0e5c9c3860-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Flow 'volume_create_manager' (0b1361c4-6ecd-4fb9-a56b-14d37996e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22dc285b-f34e-43c0-92d7-70657275c321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22dc285b-f34e-43c0-92d7-70657275c321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-758833244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6199bc7f-797e-4989-9729-0fd214c2632e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bb313649e445cca94d4c1a2248a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:27Z,use_quota=True,user_id='014417d049074120a9569b441f581dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498afba7-46bc-4090-8cab-08acf8068cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498afba7-46bc-4090-8cab-08acf8068cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ee6524-111a-4c5e-8bb3-525fc00c8104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ee6524-111a-4c5e-8bb3-525fc00c8104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6199bc7f-797e-4989-9729-0fd214c2632e', 'volume_name': 'volume-6199bc7f-797e-4989-9729-0fd214c2632e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc5d624-9f0c-4987-83d5-96160c652bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc5d624-9f0c-4987-83d5-96160c652bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef576796-7a27-423a-944e-b5303df72440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Volume 6199bc7f-797e-4989-9729-0fd214c2632e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6199bc7f-797e-4989-9729-0fd214c2632e', 'volume_size': 1} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-758833244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6199bc7f-797e-4989-9729-0fd214c2632e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bb313649e445cca94d4c1a2248a0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:27Z,use_quota=True,user_id='014417d049074120a9569b441f581dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Creating volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:27 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:19:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:27 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e 1073741824 Sep 25 16:19:27 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:28 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e 1073741824" returned: 0 in 0.820s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:28 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e Sep 25 16:19:28 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:29 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e" returned: 0 in 0.496s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef576796-7a27-423a-944e-b5303df72440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6199bc7f-797e-4989-9729-0fd214c2632e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2d9db1-0943-430d-8cfd-6d8bf69d033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:29 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Volume volume-6199bc7f-797e-4989-9729-0fd214c2632e (6199bc7f-797e-4989-9729-0fd214c2632e): created successfully Sep 25 16:19:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2d9db1-0943-430d-8cfd-6d8bf69d033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Flow 'volume_create_manager' (0b1361c4-6ecd-4fb9-a56b-14d37996e51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7a3431bd-ee51-45ac-a2bd-974a12e17b5a tempest-SnapshotsActionsTest-325447469 None] Created volume successfully. Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (e84636ff-ed5d-48f8-a98d-bd806ba3409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05dfe9a-9ba2-4b79-9718-7e21517db570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05dfe9a-9ba2-4b79-9718-7e21517db570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1170060335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee242b31-98c1-418c-a5ab-7320e3706583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:30Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416c04a6-ebae-42cd-ad82-a4c6714fe331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416c04a6-ebae-42cd-ad82-a4c6714fe331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd61ee5b-9dc6-4d6d-9239-2399a02389a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd61ee5b-9dc6-4d6d-9239-2399a02389a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee242b31-98c1-418c-a5ab-7320e3706583', 'volume_name': 'volume-ee242b31-98c1-418c-a5ab-7320e3706583', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c84ce99-9aee-4d35-913f-7fae58bcb7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c84ce99-9aee-4d35-913f-7fae58bcb7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d08c75-8a0d-4747-a4cc-8ef664a75028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:30 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Volume ee242b31-98c1-418c-a5ab-7320e3706583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee242b31-98c1-418c-a5ab-7320e3706583', 'volume_size': 1} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Creating offline snapshot 79f2568f-ba1b-4f4c-8729-b34688c9b364 of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e860407-80a8-4f25-bb75-6945c991050d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:30 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e Sep 25 16:19:30 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:30 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e" returned: 0 in 0.497s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:30 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 1G Sep 25 16:19:30 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:31 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 1G" returned: 0 in 0.547s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:31 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:31 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:31 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.342s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:31 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 is being set with open permissions: ugo+rw Sep 25 16:19:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:31 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:31 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:32 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.288s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:32 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.info Sep 25 16:19:32 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:32 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.info" returned: 0 in 0.307s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:32 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.info is being set with open permissions: ugo+rw Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:32 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.info Sep 25 16:19:32 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:32 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.info" returned: 0 in 0.275s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.361s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1170060335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee242b31-98c1-418c-a5ab-7320e3706583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:30Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Creating volume ee242b31-98c1-418c-a5ab-7320e3706583 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:32 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:19:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:32 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 1073741824 Sep 25 16:19:32 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:32 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-07d03e8f-16b3-44d6-a1bc-b3609bdb5128 tempest-SnapshotsActionsTest-325447469 None] Create snapshot completed successfully Sep 25 16:19:33 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 1073741824" returned: 0 in 0.502s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:33 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 Sep 25 16:19:33 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:33 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583" returned: 0 in 0.304s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d08c75-8a0d-4747-a4cc-8ef664a75028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee242b31-98c1-418c-a5ab-7320e3706583', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0904a78-8d9c-4747-a996-a3c599c7dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:33 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Volume volume-ee242b31-98c1-418c-a5ab-7320e3706583 (ee242b31-98c1-418c-a5ab-7320e3706583): created successfully Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0904a78-8d9c-4747-a996-a3c599c7dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (e84636ff-ed5d-48f8-a98d-bd806ba3409f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8dc9403e-a09b-4cf5-a36a-7aee514f576f tempest-VolumesActionsTest-875652822 None] Created volume successfully. Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Creating offline snapshot e8f0b938-dbde-4d50-a7fd-d2aa644c9598 of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcef1daa-3078-4081-9f86-ebb23eb07317]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:34 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:34 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-ee242b31-98c1-418c-a5ab-7320e3706583-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Lock "cinder-ee242b31-98c1-418c-a5ab-7320e3706583-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:34 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.468s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:34 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 1G Sep 25 16:19:34 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-quobyte-ee242b31-98c1-418c-a5ab-7320e3706583" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-ee242b31-98c1-418c-a5ab-7320e3706583" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4635ddd0-07c0-41e0-afd1-2094a95cf17a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:34 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 Sep 25 16:19:34 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:34 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 1G" returned: 0 in 0.615s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:34 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583" returned: 0 in 0.511s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:35 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 Sep 25 16:19:35 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:35 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583 Sep 25 16:19:35 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:35 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee242b31-98c1-418c-a5ab-7320e3706583" returned: 0 in 0.266s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-ee242b31-98c1-418c-a5ab-7320e3706583" released by "delete_volume" :: held 0.840s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Created reservations ['1e0e5691-0515-4aa9-9198-bc92e530b6ef', 'e00fe16e-a6f2-4e33-9c4a-0d8ac01dbd6e', '1978974d-a0b6-4b86-9bf0-cf0502bb8d1a', '45a9b5cc-6a43-4575-9068-06a893d622a2'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:35 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598" returned: 0 in 0.416s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:35 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 is being set with open permissions: ugo+rw Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:35 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 Sep 25 16:19:35 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:35 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:35 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:35 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598" returned: 0 in 0.359s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:35 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.335s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:35 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Deleted volume successfully. Sep 25 16:19:35 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9ffe5a79-0c41-4b6e-acc6-8769d0a179f5 tempest-SnapshotsActionsTest-325447469 None] Create snapshot completed successfully Sep 25 16:19:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-46fc87ca-a35b-4b80-a226-63f590e1fbcf tempest-VolumesActionsTest-262520389 None] Lock "cinder-ee242b31-98c1-418c-a5ab-7320e3706583-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-e8f0b938-dbde-4d50-a7fd-d2aa644c9598-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-e8f0b938-dbde-4d50-a7fd-d2aa644c9598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-e8f0b938-dbde-4d50-a7fd-d2aa644c9598" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-e8f0b938-dbde-4d50-a7fd-d2aa644c9598" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Deleting offline snapshot e8f0b938-dbde-4d50-a7fd-d2aa644c9598 of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] snapshot_file for this snap is: volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[672cfc4e-5a23-427b-b257-c6c6c02e8b8a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (02f50aa1-4052-426d-9aab-48b366ad5928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58040d39-9c43-4c47-8705-f459ef873762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58040d39-9c43-4c47-8705-f459ef873762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1065536017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92ad78c-2059-4d43-ade1-20002da0cde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:36Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d0d2af-2c04-4b99-ad11-25d793e010f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d0d2af-2c04-4b99-ad11-25d793e010f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1057397c-5d3b-4bf0-b086-981ac72b8e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:36 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1057397c-5d3b-4bf0-b086-981ac72b8e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92ad78c-2059-4d43-ade1-20002da0cde4', 'volume_name': 'volume-a92ad78c-2059-4d43-ade1-20002da0cde4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:36 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e411cd-539b-453f-bb30-ed51cb936f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e411cd-539b-453f-bb30-ed51cb936f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902674e4-6023-45d3-9d36-59c20c698c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:36 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Volume a92ad78c-2059-4d43-ade1-20002da0cde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92ad78c-2059-4d43-ade1-20002da0cde4', 'volume_size': 1} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1065536017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92ad78c-2059-4d43-ade1-20002da0cde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:36Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Creating volume a92ad78c-2059-4d43-ade1-20002da0cde4 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:36 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:36 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 1073741824 Sep 25 16:19:36 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:36 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598" returned: 0 in 0.393s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32a0bfe-f2d9-4668-8b34-d399907a3319]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:36 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:36 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:36 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 1073741824" returned: 0 in 0.499s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:36 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 Sep 25 16:19:36 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:37 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.432s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:37 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 Sep 25 16:19:37 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:37 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4" returned: 0 in 0.311s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902674e4-6023-45d3-9d36-59c20c698c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92ad78c-2059-4d43-ade1-20002da0cde4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1065aabf-641b-46b6-8526-0d9ba93a69c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:37 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Volume volume-a92ad78c-2059-4d43-ade1-20002da0cde4 (a92ad78c-2059-4d43-ade1-20002da0cde4): created successfully Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1065aabf-641b-46b6-8526-0d9ba93a69c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (02f50aa1-4052-426d-9aab-48b366ad5928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ba3ec4c8-a0bf-40b5-85b4-667788d71b62 tempest-VolumesActionsTest-875652822 None] Created volume successfully. Sep 25 16:19:37 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598" returned: 0 in 0.426s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:37 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598 Sep 25 16:19:37 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:37 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e8f0b938-dbde-4d50-a7fd-d2aa644c9598" returned: 0 in 0.291s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-e8f0b938-dbde-4d50-a7fd-d2aa644c9598" released by "_delete_snapshot" :: held 1.657s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" released by "delete_snapshot" :: held 1.678s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Created reservations ['5a488db5-5178-45cd-bbf7-072e16522901', '84c28fcf-2a0e-4a74-ad91-495f07702e64', 'ea8b0477-8a6b-4d1d-960f-2c68adbf2a8d', 'b92d2f81-a081-4491-b404-3c5c6ef812f4'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Delete snapshot completed successfully. Sep 25 16:19:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f33b247b-7485-4514-88b8-8eb80656baf7 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-e8f0b938-dbde-4d50-a7fd-d2aa644c9598-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-a92ad78c-2059-4d43-ade1-20002da0cde4-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Lock "cinder-a92ad78c-2059-4d43-ade1-20002da0cde4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-quobyte-a92ad78c-2059-4d43-ade1-20002da0cde4" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-a92ad78c-2059-4d43-ade1-20002da0cde4" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c1c7c-5c3e-4713-ab43-933b85697aa7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Creating offline snapshot 3e63d8fa-f2ca-4898-b502-968b1df84bae of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713e6c3-457a-46ae-acea-087db98ecc54]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:38 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 Sep 25 16:19:38 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:38 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:38 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:39 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4" returned: 0 in 0.503s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:39 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4 Sep 25 16:19:39 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:39 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.479s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:39 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae 1G Sep 25 16:19:39 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:39 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a92ad78c-2059-4d43-ade1-20002da0cde4" returned: 0 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-a92ad78c-2059-4d43-ade1-20002da0cde4" released by "delete_volume" :: held 0.946s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Created reservations ['ea1cf245-ffe1-41ac-91b0-364ff7274747', '772423d8-c325-4b8d-b6f8-b1b7afea1050', 'c5b6e405-9c2c-4e20-b2a9-d8ef6dcb56b0', '909e229c-e370-40f2-b95a-52c6edeb783e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:39 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:39 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:40 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae 1G" returned: 0 in 0.760s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:40 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae Sep 25 16:19:40 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:40 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.366s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:40 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:40 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Deleted volume successfully. Sep 25 16:19:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1f287c0f-e75a-4e83-b883-c5b5c51cee6a tempest-VolumesActionsTest-262520389 None] Lock "cinder-a92ad78c-2059-4d43-ade1-20002da0cde4-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:40 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae" returned: 0 in 0.467s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:40 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae is being set with open permissions: ugo+rw Sep 25 16:19:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:40 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae Sep 25 16:19:40 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:41 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae" returned: 0 in 0.461s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.333s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-41c96fa5-11ad-4495-89bd-00f9f61fbdb7 tempest-SnapshotsActionsTest-325447469 None] Create snapshot completed successfully Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (b2de40a2-b574-42b9-9e47-1581921ba62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7981999a-b2c8-4f62-bf12-d2c9953cb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7981999a-b2c8-4f62-bf12-d2c9953cb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832978481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94231559-0651-40f0-82af-77ded0405f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:42Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c2e39-9db6-4bb2-b845-5cac94f1c55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c2e39-9db6-4bb2-b845-5cac94f1c55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27832b60-a631-4f5a-ae8a-c169f3102112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27832b60-a631-4f5a-ae8a-c169f3102112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94231559-0651-40f0-82af-77ded0405f7a', 'volume_name': 'volume-94231559-0651-40f0-82af-77ded0405f7a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601afcd3-7957-4bdd-9dc0-ca2f8615577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601afcd3-7957-4bdd-9dc0-ca2f8615577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6cab63-11a6-4b37-8eb1-5a1c6945dd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:41 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Volume 94231559-0651-40f0-82af-77ded0405f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94231559-0651-40f0-82af-77ded0405f7a', 'volume_size': 1} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-832978481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94231559-0651-40f0-82af-77ded0405f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:42Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Creating volume 94231559-0651-40f0-82af-77ded0405f7a {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:41 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:19:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:41 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a 1073741824 Sep 25 16:19:41 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-3e63d8fa-f2ca-4898-b502-968b1df84bae-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-3e63d8fa-f2ca-4898-b502-968b1df84bae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-3e63d8fa-f2ca-4898-b502-968b1df84bae" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-3e63d8fa-f2ca-4898-b502-968b1df84bae" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Deleting offline snapshot 3e63d8fa-f2ca-4898-b502-968b1df84bae of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] snapshot_file for this snap is: volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[34170ad2-a3ff-47bf-8790-990b625d75f2]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:42 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae Sep 25 16:19:42 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:42 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a 1073741824" returned: 0 in 0.751s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:42 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a Sep 25 16:19:42 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:43 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae" returned: 0 in 0.710s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab92efbf-6a66-443c-a149-b02109c5eb8e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:43 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a" returned: 0 in 0.443s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6cab63-11a6-4b37-8eb1-5a1c6945dd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94231559-0651-40f0-82af-77ded0405f7a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823bd456-9a6c-4110-a83a-56ffc088b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Volume volume-94231559-0651-40f0-82af-77ded0405f7a (94231559-0651-40f0-82af-77ded0405f7a): created successfully Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823bd456-9a6c-4110-a83a-56ffc088b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (b2de40a2-b574-42b9-9e47-1581921ba62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:43 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-69a6f6c8-2f70-41b2-b035-790cf322e31c tempest-VolumesActionsTest-875652822 None] Created volume successfully. Sep 25 16:19:43 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:43 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:43 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.533s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:43 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae Sep 25 16:19:43 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-94231559-0651-40f0-82af-77ded0405f7a-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Lock "cinder-94231559-0651-40f0-82af-77ded0405f7a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-quobyte-94231559-0651-40f0-82af-77ded0405f7a" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-94231559-0651-40f0-82af-77ded0405f7a" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ea479-502e-4d07-ac49-d39c84f8489f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:44 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae" returned: 0 in 0.952s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:44 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae Sep 25 16:19:44 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:44 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a Sep 25 16:19:44 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-5ef399c5-ff1f-448b-be49-eb656936faab req-ea162daa-78d7-4725-ac82-b9b1eee1ae86 tempest-TestMinimumBasicScenario-1417941848 None] Terminate volume connection completed successfully. Sep 25 16:19:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-5ef399c5-ff1f-448b-be49-eb656936faab req-ea162daa-78d7-4725-ac82-b9b1eee1ae86 tempest-TestMinimumBasicScenario-1417941848 None] Deleting attachment dbb039c1-4fb5-4c0a-9963-606203ec5d1d. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:19:45 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.3e63d8fa-f2ca-4898-b502-968b1df84bae" returned: 0 in 0.450s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-3e63d8fa-f2ca-4898-b502-968b1df84bae" released by "_delete_snapshot" :: held 2.793s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" released by "delete_snapshot" :: held 2.842s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:45 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a" returned: 0 in 0.644s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:45 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a Sep 25 16:19:45 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Created reservations ['927aca6e-002d-4230-9e1b-37f45043012c', 'd11708a2-bca6-46f2-ac14-b91141c6be2d', '6d90333b-36fb-4ef7-aae9-b98452103dac', '3481a487-2624-44e2-9711-0c901fa162f5'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:45 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Delete snapshot completed successfully. Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ffe05a5-dd5e-49d6-9563-b76763fa70e6 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-3e63d8fa-f2ca-4898-b502-968b1df84bae-delete_snapshot" released by "delete_snapshot" :: held 3.232s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:45 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-94231559-0651-40f0-82af-77ded0405f7a" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-94231559-0651-40f0-82af-77ded0405f7a" released by "delete_volume" :: held 1.202s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Acquiring lock "cinder-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Created reservations ['8859a40e-0716-490f-9607-9668f1b3a0d5', '88d01202-f0ea-42b3-bfcd-f0827e2b0cab', '22291b96-bdf3-4d36-a940-fb04c35f0b78', 'fedcf462-6650-44cb-915e-7e1c57441a1f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Lock "cinder-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Acquiring lock "cinder-quobyte-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Lock "cinder-quobyte-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7" acquired by "delete_volume" :: waited 0.061s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:45 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:45 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00407d-34dc-4371-a028-25d75a93f83e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-487fea82-5a08-43c3-8bb6-b8f6673817eb req-b314957c-7e86-4d26-9682-bbb32ca55a44 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-487fea82-5a08-43c3-8bb6-b8f6673817eb req-b314957c-7e86-4d26-9682-bbb32ca55a44 tempest-TestStampPattern-1875593839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-487fea82-5a08-43c3-8bb6-b8f6673817eb req-b314957c-7e86-4d26-9682-bbb32ca55a44 tempest-TestStampPattern-1875593839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-487fea82-5a08-43c3-8bb6-b8f6673817eb req-b314957c-7e86-4d26-9682-bbb32ca55a44 tempest-TestStampPattern-1875593839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30587f35-0967-4e8d-85f0-803daf734c39', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:19:46 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 Sep 25 16:19:46 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-487fea82-5a08-43c3-8bb6-b8f6673817eb req-b314957c-7e86-4d26-9682-bbb32ca55a44 tempest-TestStampPattern-1875593839 None] attachment_update completed successfully. Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Creating offline snapshot e5cc2cbd-7318-4422-b1e8-0d8361f37127 of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7618c2e7-a786-4791-aa98-df76a73474ee]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:46 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.439s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Deleted volume successfully. Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-06b950a5-4e19-4599-9c00-e75adb2d060c tempest-VolumesActionsTest-262520389 None] Lock "cinder-94231559-0651-40f0-82af-77ded0405f7a-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:46 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:46 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:46 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7" returned: 0 in 0.729s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:46 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7 Sep 25 16:19:46 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:47 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.774s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:47 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 1G Sep 25 16:19:47 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:47 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7" returned: 0 in 0.558s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Lock "cinder-quobyte-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7" released by "delete_volume" :: held 1.390s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Created reservations ['b8e6c627-31dd-46f0-81fd-3fb69f7fb556', 'b913dee5-40f4-43e6-a41a-047cbb68cccf', '1f0bc4b5-9354-4cc4-8f6d-6ef872bd87b6', 'fa7bc519-8174-4cbd-babf-4f08fbc6a14c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:47 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:47 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:48 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 1G" returned: 0 in 0.856s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:48 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 Sep 25 16:19:48 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (8db3217c-0cd0-4560-8675-f6cc9e742649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0087f735-4243-4c9b-ad9b-4d3db93c5c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0087f735-4243-4c9b-ad9b-4d3db93c5c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067902536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8715b117-db90-43eb-9db6-7365660745b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:48Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff79ea8-4314-4ea9-a94a-e986baf6a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff79ea8-4314-4ea9-a94a-e986baf6a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffea495c-6396-4211-9e31-d8e3f1023a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffea495c-6396-4211-9e31-d8e3f1023a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8715b117-db90-43eb-9db6-7365660745b0', 'volume_name': 'volume-8715b117-db90-43eb-9db6-7365660745b0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:48 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dff961f-861f-4b7a-bed2-adf623c506e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dff961f-861f-4b7a-bed2-adf623c506e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96248a89-03d1-4dd3-aa0e-9038fc782bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Volume 8715b117-db90-43eb-9db6-7365660745b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8715b117-db90-43eb-9db6-7365660745b0', 'volume_size': 1} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.539s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Deleted volume successfully. Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fc65f87b-da67-49dd-83d2-3a13586a5969 tempest-TestMinimumBasicScenario-1417941848 None] Lock "cinder-1a22ed37-e26d-4113-aa93-f4a6ef6c53b7-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:48 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127" returned: 0 in 0.401s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:48 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 is being set with open permissions: ugo+rw Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:48 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 Sep 25 16:19:48 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:48 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127" returned: 0 in 0.341s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.523s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067902536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8715b117-db90-43eb-9db6-7365660745b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:48Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Creating volume 8715b117-db90-43eb-9db6-7365660745b0 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:48 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:19:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:48 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 1073741824 Sep 25 16:19:48 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2d935849-9d0a-49cf-81ae-a82dd0fc35be tempest-SnapshotsActionsTest-325447469 None] Create snapshot completed successfully Sep 25 16:19:49 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 1073741824" returned: 0 in 0.851s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:49 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 Sep 25 16:19:49 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-e5cc2cbd-7318-4422-b1e8-0d8361f37127-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-e5cc2cbd-7318-4422-b1e8-0d8361f37127-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-e5cc2cbd-7318-4422-b1e8-0d8361f37127" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-e5cc2cbd-7318-4422-b1e8-0d8361f37127" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Deleting offline snapshot e5cc2cbd-7318-4422-b1e8-0d8361f37127 of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] snapshot_file for this snap is: volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8b7eb-87d8-43de-8639-3b296ea592ed]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:50 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 Sep 25 16:19:50 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:50 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0" returned: 0 in 0.420s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96248a89-03d1-4dd3-aa0e-9038fc782bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8715b117-db90-43eb-9db6-7365660745b0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fe5f43-c1d1-49fc-a2b6-fbb983c52f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Volume volume-8715b117-db90-43eb-9db6-7365660745b0 (8715b117-db90-43eb-9db6-7365660745b0): created successfully Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fe5f43-c1d1-49fc-a2b6-fbb983c52f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (8db3217c-0cd0-4560-8675-f6cc9e742649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9ac2b7f2-a343-4fdd-afc4-79853adf2ee5 tempest-VolumesActionsTest-875652822 None] Created volume successfully. Sep 25 16:19:50 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127" returned: 0 in 0.582s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[75137223-ff20-47e0-9d8c-5eda0a470f7b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:50 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:50 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:51 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.605s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:51 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 Sep 25 16:19:51 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-8715b117-db90-43eb-9db6-7365660745b0-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Lock "cinder-8715b117-db90-43eb-9db6-7365660745b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:51 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127" returned: 0 in 0.664s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:51 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127 Sep 25 16:19:51 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Acquiring lock "cinder-quobyte-8715b117-db90-43eb-9db6-7365660745b0" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-8715b117-db90-43eb-9db6-7365660745b0" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8f9632-9c32-495c-8ddc-d7192eaa379f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:52 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 Sep 25 16:19:52 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:52 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.e5cc2cbd-7318-4422-b1e8-0d8361f37127" returned: 0 in 0.439s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-e5cc2cbd-7318-4422-b1e8-0d8361f37127" released by "_delete_snapshot" :: held 2.432s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" released by "delete_snapshot" :: held 2.464s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Created reservations ['ee3ff5ab-6152-407b-bb29-41697d0ef9e0', '2a55bc02-71a0-4ecb-99f9-f1f95dbce80a', 'bc612838-b8a5-43b9-87fe-ee10346ff107', '6168d260-7218-45ee-8fc4-854ed158572e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:52 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0" returned: 0 in 0.469s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:52 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0 Sep 25 16:19:52 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Delete snapshot completed successfully. Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7e77cc05-eca5-46b1-b9d9-0eff57530a62 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-e5cc2cbd-7318-4422-b1e8-0d8361f37127-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:52 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8715b117-db90-43eb-9db6-7365660745b0" returned: 0 in 0.306s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Lock "cinder-quobyte-8715b117-db90-43eb-9db6-7365660745b0" released by "delete_volume" :: held 0.864s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:52 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Created reservations ['a66e88b4-14da-4b06-bb89-5b7fe6edace2', 'a37abead-eab5-45d4-b7eb-7cb101bb745b', 'd1707151-560e-4d62-82cf-96d4ae20bbe2', 'e8a1a197-a6c5-4c5c-b111-c57f3dad41ec'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:53 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:19:53 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:53 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.479s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:19:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Deleted volume successfully. Sep 25 16:19:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-11126857-417a-4c1e-9661-c4fe6ef6196e tempest-VolumesActionsTest-262520389 None] Lock "cinder-8715b117-db90-43eb-9db6-7365660745b0-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (8e3711ea-a858-45c3-9d6d-8a2250642d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce3af36-8a5f-4aed-9562-dec4fe730a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Creating offline snapshot 2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849fa9c-8871-4700-979e-40e077ebf520]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce3af36-8a5f-4aed-9562-dec4fe730a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-742734982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03777978-c3c0-4a3c-8cc2-bb59486226cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:54Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be67e5-3af9-450f-8e5a-727346eea89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be67e5-3af9-450f-8e5a-727346eea89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4560ede-5fc5-4dba-a000-5ee7d124cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4560ede-5fc5-4dba-a000-5ee7d124cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03777978-c3c0-4a3c-8cc2-bb59486226cd', 'volume_name': 'volume-03777978-c3c0-4a3c-8cc2-bb59486226cd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9c39e2-8090-4cad-bfa5-b8f29699c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9c39e2-8090-4cad-bfa5-b8f29699c111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d6a11e-65fc-4ae7-a57e-806d18578ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:54 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Volume 03777978-c3c0-4a3c-8cc2-bb59486226cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03777978-c3c0-4a3c-8cc2-bb59486226cd', 'volume_size': 1} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-6e7747c5-c991-4374-aca9-1cda81dedaa9 req-cfdab543-73d9-4cea-ae04-3a6a56109410 tempest-TestStampPattern-1875593839 None] Terminate volume connection completed successfully. Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-6e7747c5-c991-4374-aca9-1cda81dedaa9 req-cfdab543-73d9-4cea-ae04-3a6a56109410 tempest-TestStampPattern-1875593839 None] Deleting attachment 30587f35-0967-4e8d-85f0-803daf734c39. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:19:54 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:54 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:54 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.505s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:54 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf 1G Sep 25 16:19:54 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:55 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf 1G" returned: 0 in 0.588s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:55 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf Sep 25 16:19:55 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:55 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" returned: 0 in 0.341s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:55 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf is being set with open permissions: ugo+rw Sep 25 16:19:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:55 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf Sep 25 16:19:55 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:56 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" returned: 0 in 0.321s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-742734982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03777978-c3c0-4a3c-8cc2-bb59486226cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3b6b5a1743427d86b18047f13f7fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:19:54Z,use_quota=True,user_id='78cb53829548422eb8888f0351161bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Creating volume 03777978-c3c0-4a3c-8cc2-bb59486226cd {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:19:56 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:56 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd 1073741824 Sep 25 16:19:56 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b39d2e68-644f-4c04-b810-9d444d99b300 tempest-SnapshotsActionsTest-325447469 None] Create snapshot completed successfully Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:19:56 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd 1073741824" returned: 0 in 0.551s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:56 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd Sep 25 16:19:56 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:57 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd" returned: 0 in 0.301s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.847s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Creating offline snapshot 2dc974d1-9eef-45c6-be9a-03724b4dd6a2 of volume c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d6a11e-65fc-4ae7-a57e-806d18578ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03777978-c3c0-4a3c-8cc2-bb59486226cd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c164a-6a18-4863-b01d-0cf6e2443c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[631cf5cd-8cd3-4649-84b9-16e2e1d6591e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Volume volume-03777978-c3c0-4a3c-8cc2-bb59486226cd (03777978-c3c0-4a3c-8cc2-bb59486226cd): created successfully Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c164a-6a18-4863-b01d-0cf6e2443c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Flow 'volume_create_manager' (8e3711ea-a858-45c3-9d6d-8a2250642d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2e6b6807-e13e-4e6f-9e3f-98526596d38e tempest-VolumesActionsTest-875652822 None] Created volume successfully. Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Acquiring lock "cinder-quobyte-2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Deleting offline snapshot 2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] snapshot_file for this snap is: volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:19:57 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 Sep 25 16:19:57 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8391f-c382-4aca-a408-a2f36b9b112e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:57 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf Sep 25 16:19:57 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:57 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" returned: 0 in 0.421s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:57 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 1G Sep 25 16:19:57 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:57 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" returned: 0 in 0.386s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3de4ac-f076-4143-aef7-dcff173a4d35]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:57 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:19:57 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 1G" returned: 0 in 0.633s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:58 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 Sep 25 16:19:58 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.588s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:58 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf Sep 25 16:19:58 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2" returned: 0 in 0.475s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:58 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 is being set with open permissions: ugo+rw Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:58 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 Sep 25 16:19:58 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:58 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" returned: 0 in 0.640s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:59 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf Sep 25 16:19:59 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Acquiring lock "cinder-03777978-c3c0-4a3c-8cc2-bb59486226cd-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Lock "cinder-03777978-c3c0-4a3c-8cc2-bb59486226cd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:59 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2" returned: 0 in 0.474s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Acquiring lock "cinder-quobyte-03777978-c3c0-4a3c-8cc2-bb59486226cd" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:19:59 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.info Sep 25 16:19:59 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Lock "cinder-quobyte-03777978-c3c0-4a3c-8cc2-bb59486226cd" acquired by "delete_volume" :: waited 0.055s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f3a58c-bc51-4924-adaf-e5a2cc7b816f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:59 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" returned: 0 in 0.438s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf" released by "_delete_snapshot" :: held 2.189s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" released by "delete_snapshot" :: held 2.215s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:59 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd Sep 25 16:19:59 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Created reservations ['bfa154fa-afba-4517-9df3-0ff6e3f4a322', '7c39e9c0-edce-4b7f-872a-5fa226b89510', 'f7de524c-cf6e-455a-8ffd-f0166619e418', '8814d43f-89ea-425b-b23b-3466938da23f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:19:59 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.info" returned: 0 in 0.396s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:59 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.info is being set with open permissions: ugo+rw Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Delete snapshot completed successfully. Sep 25 16:19:59 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.info Sep 25 16:19:59 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3fe8a9a9-d720-4ab7-a6d0-73abe2398921 tempest-SnapshotsActionsTest-688498902 None] Lock "cinder-2c8176b2-2ea8-4e9f-bad6-ff2f3baa5adf-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:19:59 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd" returned: 0 in 0.511s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:19:59 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd Sep 25 16:19:59 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:19:59 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 25 16:19:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.info" returned: 0 in 0.360s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.911s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-cff6b9ce-9e34-4e24-8327-3bfc2f558e8a tempest-TestStampPattern-1875593839 None] Create snapshot completed successfully Sep 25 16:20:00 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-03777978-c3c0-4a3c-8cc2-bb59486226cd" returned: 0 in 0.325s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Lock "cinder-quobyte-03777978-c3c0-4a3c-8cc2-bb59486226cd" released by "delete_volume" :: held 0.948s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Created reservations ['c5ce785c-f53a-4499-9816-437839f59865', '653c9487-443c-4503-bde0-d5e84aa887a6', '6ba13dc2-2525-4b9e-ba47-a466e1da8780', '54da2354-3928-4114-ac1c-2cf36d72f002'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:00 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:20:00 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:00 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.420s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Deleted volume successfully. Sep 25 16:20:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-95aadde0-4636-4289-8a84-73e85566713c tempest-VolumesActionsTest-875652822 None] Lock "cinder-03777978-c3c0-4a3c-8cc2-bb59486226cd-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "cinder-79f2568f-ba1b-4f4c-8729-b34688c9b364-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-79f2568f-ba1b-4f4c-8729-b34688c9b364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "cinder-quobyte-79f2568f-ba1b-4f4c-8729-b34688c9b364" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-quobyte-79f2568f-ba1b-4f4c-8729-b34688c9b364" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Deleting offline snapshot 79f2568f-ba1b-4f4c-8729-b34688c9b364 of volume 6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] snapshot_file for this snap is: volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2712f01b-8281-43a6-93fe-5e44affc7687]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:01 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:20:01 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:01 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.580s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6199bc7f-797e-4989-9729-0fd214c2632e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b339eb62-d20f-44fc-9cbe-ba25b0e29261]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:02 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e Sep 25 16:20:02 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:02 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e" returned: 0 in 0.765s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:02 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:20:02 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:03 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.625s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:03 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364 Sep 25 16:20:03 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:03 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e.79f2568f-ba1b-4f4c-8729-b34688c9b364" returned: 0 in 0.459s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-quobyte-79f2568f-ba1b-4f4c-8729-b34688c9b364" released by "_delete_snapshot" :: held 2.646s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" released by "delete_snapshot" :: held 2.693s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:03 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Created reservations ['f6737c0d-1c01-4810-b7be-d0acfed52dd6', 'ba33f80a-0c0c-4c59-aa2f-05ccf5c101ee', '757f8c62-94fd-412b-8806-3580ada5298a', '2dca6ef9-1c8e-4cf8-b1dc-a32ee9487843'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:03 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Delete snapshot completed successfully. Sep 25 16:20:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-76280812-6e8a-4583-b8f2-5939dd18b4e4 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-79f2568f-ba1b-4f4c-8729-b34688c9b364-delete_snapshot" released by "delete_snapshot" :: held 2.919s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "cinder-6199bc7f-797e-4989-9729-0fd214c2632e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-6199bc7f-797e-4989-9729-0fd214c2632e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f38ced-9f1a-4ecc-80c5-77e9bef08d02]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:04 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e Sep 25 16:20:04 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:05 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e" returned: 0 in 0.696s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:05 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e Sep 25 16:20:05 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:05 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6199bc7f-797e-4989-9729-0fd214c2632e" returned: 0 in 0.403s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-quobyte-6199bc7f-797e-4989-9729-0fd214c2632e" released by "delete_volume" :: held 1.186s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=123,cinder:INSERT=35,cinder:UPDATE=126,cinder:DELETE=9 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=119,cinder:INSERT=33,cinder:UPDATE=142,cinder:DELETE=11 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Created reservations ['bfab7efa-a68f-43fe-917b-d914dec01545', 'c3b354a1-f6f9-4e39-9e02-ba1e6661036e', '1286a4e7-cf42-4832-9b8a-19710759dacf', '29361315-a1ff-4e17-bae4-8877d562c214'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:05 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:20:05 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:06 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.435s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:06 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Deleted volume successfully. Sep 25 16:20:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-619d64cd-a095-439e-806b-180aee5c29c1 tempest-SnapshotsActionsTest-325447469 None] Lock "cinder-6199bc7f-797e-4989-9729-0fd214c2632e-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Flow 'volume_create_manager' (94ccc2a4-c791-49e0-ba6d-f33705dfa410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfddcfea-f916-4f07-a117-ab7cdc199a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfddcfea-f916-4f07-a117-ab7cdc199a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1323471226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4b55a4-b377-4059-9219-3466043e1480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85ed0d9e3bd41cfbe4be771dd0a09a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2dc974d1-9eef-45c6-be9a-03724b4dd6a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:11Z,use_quota=True,user_id='18f114cc4a9b46b184eeb1501c3f264b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490ea1d7-2223-4496-b31b-162ed33208fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490ea1d7-2223-4496-b31b-162ed33208fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815bf3bc-6ee3-443c-b31c-6d3192143d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815bf3bc-6ee3-443c-b31c-6d3192143d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee4b55a4-b377-4059-9219-3466043e1480', 'volume_name': 'volume-ee4b55a4-b377-4059-9219-3466043e1480', 'volume_size': 1, 'snapshot_id': '2dc974d1-9eef-45c6-be9a-03724b4dd6a2'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3389ec3c-e300-49c4-8d93-fdacea004e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3389ec3c-e300-49c4-8d93-fdacea004e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9248f28-7663-4c23-a421-65f1508fcbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:11 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Volume ee4b55a4-b377-4059-9219-3466043e1480: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee4b55a4-b377-4059-9219-3466043e1480', 'volume_size': 1, 'snapshot_id': '2dc974d1-9eef-45c6-be9a-03724b4dd6a2'} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-quobyte-2dc974d1-9eef-45c6-be9a-03724b4dd6a2-ee4b55a4-b377-4059-9219-3466043e1480" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-2dc974d1-9eef-45c6-be9a-03724b4dd6a2-ee4b55a4-b377-4059-9219-3466043e1480" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Creating volume ee4b55a4-b377-4059-9219-3466043e1480 from snapshot 2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-quobyte-ee4b55a4-b377-4059-9219-3466043e1480" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-ee4b55a4-b377-4059-9219-3466043e1480" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] snapshot: 2dc974d1-9eef-45c6-be9a-03724b4dd6a2, volume: ee4b55a4-b377-4059-9219-3466043e1480, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[519dbb82-588f-4bc8-929c-4f15348321df]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:12 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 Sep 25 16:20:12 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:12 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2" returned: 0 in 0.781s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[854fe68c-16a7-4851-8514-b86e4f95612e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:12 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 Sep 25 16:20:12 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:13 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" returned: 0 in 0.535s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:20:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:20:13 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:20:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:13 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 Sep 25 16:20:13 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:20:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:15 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:20:15 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:16 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.624s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:20:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:20:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:20:21 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:21 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:24 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480" returned: 0 in 11.186s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:24 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0, size 1024.00 MB, duration 11.19 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:20:24 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Converted 1024.00 MB image at 91.53 MB/s Sep 25 16:20:24 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 is being set with open permissions: ugo+rw Sep 25 16:20:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:24 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 Sep 25 16:20:24 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:25 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480" returned: 0 in 0.691s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-ee4b55a4-b377-4059-9219-3466043e1480" released by "_copy_volume_from_snapshot" :: held 13.348s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-2dc974d1-9eef-45c6-be9a-03724b4dd6a2-ee4b55a4-b377-4059-9219-3466043e1480" released by "_create_volume_from_snapshot" :: held 13.499s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.528s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9248f28-7663-4c23-a421-65f1508fcbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4b55a4-b377-4059-9219-3466043e1480', 'volume_size': 1, 'snapshot_id': '2dc974d1-9eef-45c6-be9a-03724b4dd6a2'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90f8696-1cd7-4cb7-a16b-5684f4e51b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Volume volume-ee4b55a4-b377-4059-9219-3466043e1480 (ee4b55a4-b377-4059-9219-3466043e1480): created successfully Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90f8696-1cd7-4cb7-a16b-5684f4e51b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Flow 'volume_create_manager' (94ccc2a4-c791-49e0-ba6d-f33705dfa410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-37d1e670-7502-4f7b-b25f-f547b3263e83 tempest-TestStampPattern-1875593839 None] Created volume successfully. Sep 25 16:20:35 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:35 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Flow 'volume_create_manager' (604fc99a-179f-4c34-8d15-8c4bfcab0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd81874-5312-493c-9521-2075698b88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd81874-5312-493c-9521-2075698b88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-546944350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bcac56-1feb-4f7c-b931-b9829e3ab974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be33838d21614221b7aca1dbe91f9e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:41Z,use_quota=True,user_id='9d8dc5b3697c48a7b6d02825820ed1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082d98f3-2018-41ec-bcd6-6913f52d863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082d98f3-2018-41ec-bcd6-6913f52d863d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00af7b04-a50f-4f9f-b348-a4bce0c697ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00af7b04-a50f-4f9f-b348-a4bce0c697ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bcac56-1feb-4f7c-b931-b9829e3ab974', 'volume_name': 'volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4494033-da81-4474-9243-fce9ad7bb5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4494033-da81-4474-9243-fce9ad7bb5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4962830-1b56-4a43-b6c6-89fd3f245bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:41 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Volume d3bcac56-1feb-4f7c-b931-b9829e3ab974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974', 'volume_size': 1} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-546944350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bcac56-1feb-4f7c-b931-b9829e3ab974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be33838d21614221b7aca1dbe91f9e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:41Z,use_quota=True,user_id='9d8dc5b3697c48a7b6d02825820ed1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Creating volume d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:41 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:41 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 1073741824 Sep 25 16:20:41 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:41 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Flow 'volume_create_manager' (62260f92-0606-473d-87c8-0fa20ca16a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc57de8d-bbc6-48c0-adde-961270fe32b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc57de8d-bbc6-48c0-adde-961270fe32b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-171622118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ae854b-7e7d-4f4a-93c8-3d3baf27bea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28deaebf7cad4d4fb39cbd1a776726f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:42Z,use_quota=True,user_id='3e7252ffc49c4ebf932ea46a3fe83123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b9b9d7-8b36-4cf5-aec3-ff456359e00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b9b9d7-8b36-4cf5-aec3-ff456359e00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e771de-b3c5-4c32-948a-a47b84519887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e771de-b3c5-4c32-948a-a47b84519887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ae854b-7e7d-4f4a-93c8-3d3baf27bea8', 'volume_name': 'volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84631d78-c28f-453e-957b-6e00e1876080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84631d78-c28f-453e-957b-6e00e1876080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00e5a90-f292-46e1-904b-4942bd433c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:42 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Volume 82ae854b-7e7d-4f4a-93c8-3d3baf27bea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8', 'volume_size': 1} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:42 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 1073741824" returned: 0 in 0.862s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:42 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 Sep 25 16:20:42 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:43 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974" returned: 0 in 0.518s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.832s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-171622118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ae854b-7e7d-4f4a-93c8-3d3baf27bea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28deaebf7cad4d4fb39cbd1a776726f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:42Z,use_quota=True,user_id='3e7252ffc49c4ebf932ea46a3fe83123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Creating volume 82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:43 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4962830-1b56-4a43-b6c6-89fd3f245bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d225f943-a3db-4a84-949a-37b9267cbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:43 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 1073741824 Sep 25 16:20:43 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Volume volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 (d3bcac56-1feb-4f7c-b931-b9829e3ab974): created successfully Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d225f943-a3db-4a84-949a-37b9267cbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Flow 'volume_create_manager' (604fc99a-179f-4c34-8d15-8c4bfcab0653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:43 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-840c2aa1-6232-4600-90a6-c40093435eec tempest-VolumesDeleteCascade-96206807 None] Created volume successfully. Sep 25 16:20:43 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 1073741824" returned: 0 in 0.761s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:44 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 Sep 25 16:20:44 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:44 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8" returned: 0 in 0.388s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00e5a90-f292-46e1-904b-4942bd433c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db0ab61-fa70-4438-a1e8-084b4d2c6732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:44 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Volume volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 (82ae854b-7e7d-4f4a-93c8-3d3baf27bea8): created successfully Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db0ab61-fa70-4438-a1e8-084b4d2c6732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Flow 'volume_create_manager' (62260f92-0606-473d-87c8-0fa20ca16a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e0ab8c15-1de6-4a2f-ac2c-8c1579276ada tempest-VolumeQuotasAdminTestJSON-880997515 None] Created volume successfully. Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Acquiring lock "cinder-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "cinder-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Creating offline snapshot d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 of volume d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[12074848-dea0-4154-bc96-e2da4ce9957d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Acquiring lock "cinder-quobyte-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "cinder-quobyte-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd657d90-0573-45b2-a5f8-bcfd66a56ea2]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:45 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 Sep 25 16:20:45 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:45 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 Sep 25 16:20:45 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:46 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974" returned: 0 in 1.081s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:46 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 1G Sep 25 16:20:46 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:46 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8" returned: 0 in 1.059s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:46 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8 Sep 25 16:20:46 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:47 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8" returned: 0 in 0.428s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "cinder-quobyte-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8" released by "delete_volume" :: held 1.626s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Created reservations ['4ac86855-b8ae-4251-b948-714b61de7dfc', '72e70e13-2dbe-41db-a2e0-46e51a154944', '33ecb6d9-4645-4d43-8640-b019cbf01bd6', '20842371-4b13-44fa-a6a3-d7c6b20947fd'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:47 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:20:47 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:47 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 1G" returned: 0 in 1.133s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:47 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 Sep 25 16:20:47 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:47 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.409s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Deleted volume successfully. Sep 25 16:20:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3c5ada51-d2fd-4613-a29a-cc2cd790f9d4 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "cinder-82ae854b-7e7d-4f4a-93c8-3d3baf27bea8-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:48 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" returned: 0 in 0.851s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:48 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 is being set with open permissions: ugo+rw Sep 25 16:20:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:48 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 Sep 25 16:20:48 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:49 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" returned: 0 in 0.596s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:20:49 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.info Sep 25 16:20:49 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Flow 'volume_create_manager' (5840fb30-b1e0-496a-a50a-b36aafffe106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce96b0b-4732-4c24-8865-74deae1e00cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce96b0b-4732-4c24-8865-74deae1e00cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1007563600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b78940b-d017-4097-a255-a55e6dc38c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28deaebf7cad4d4fb39cbd1a776726f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:49Z,use_quota=True,user_id='3e7252ffc49c4ebf932ea46a3fe83123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17ae3eb-2e6c-42e3-8555-ad361f760be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17ae3eb-2e6c-42e3-8555-ad361f760be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6040f7d3-5584-4169-9805-f4adeea768f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6040f7d3-5584-4169-9805-f4adeea768f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b78940b-d017-4097-a255-a55e6dc38c00', 'volume_name': 'volume-4b78940b-d017-4097-a255-a55e6dc38c00', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef05aad-68e7-4661-a02d-9633c8cd4742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef05aad-68e7-4661-a02d-9633c8cd4742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208d1cc2-7a5d-43fa-8399-631b402aa377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Volume 4b78940b-d017-4097-a255-a55e6dc38c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b78940b-d017-4097-a255-a55e6dc38c00', 'volume_size': 1} Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:49 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.info" returned: 0 in 0.432s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:49 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.info is being set with open permissions: ugo+rw Sep 25 16:20:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:49 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.info Sep 25 16:20:49 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:50 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.info" returned: 0 in 0.312s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.732s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1007563600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b78940b-d017-4097-a255-a55e6dc38c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28deaebf7cad4d4fb39cbd1a776726f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:20:49Z,use_quota=True,user_id='3e7252ffc49c4ebf932ea46a3fe83123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Creating volume 4b78940b-d017-4097-a255-a55e6dc38c00 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:20:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:50 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 1073741824 Sep 25 16:20:50 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-938b9ec6-0b54-4cf8-a3e6-c1aca3cc93c1 tempest-VolumesDeleteCascade-96206807 None] Create snapshot completed successfully Sep 25 16:20:50 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 1073741824" returned: 0 in 0.538s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:50 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 Sep 25 16:20:50 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:51 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00" returned: 0 in 0.390s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.046s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Creating offline snapshot bf12d021-9101-49b1-b5e2-d478d70cd05e of volume d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208d1cc2-7a5d-43fa-8399-631b402aa377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b78940b-d017-4097-a255-a55e6dc38c00', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899cdc34-e31f-477f-88f2-047575c49d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7578c491-7a1f-4285-83ff-cb7d67c3851a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Volume volume-4b78940b-d017-4097-a255-a55e6dc38c00 (4b78940b-d017-4097-a255-a55e6dc38c00): created successfully Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899cdc34-e31f-477f-88f2-047575c49d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Flow 'volume_create_manager' (5840fb30-b1e0-496a-a50a-b36aafffe106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:20:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1212d2dc-b19a-4e3f-9e93-d00206bc4975 tempest-VolumeQuotasAdminTestJSON-880997515 None] Created volume successfully. Sep 25 16:20:51 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 Sep 25 16:20:51 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:51 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" returned: 0 in 0.493s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:51 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e 1G Sep 25 16:20:51 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2a1306bc-af0a-475a-905f-77898f503c3d tempest-VolumeQuotasAdminTestJSON-1893077122 None] Transfer volume completed successfully. Sep 25 16:20:52 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e 1G" returned: 0 in 0.693s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:52 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e Sep 25 16:20:52 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:52 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e" returned: 0 in 0.431s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:52 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e is being set with open permissions: ugo+rw Sep 25 16:20:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:52 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e Sep 25 16:20:52 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Acquiring lock "cinder-4b78940b-d017-4097-a255-a55e6dc38c00-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Lock "cinder-4b78940b-d017-4097-a255-a55e6dc38c00-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Acquiring lock "cinder-quobyte-4b78940b-d017-4097-a255-a55e6dc38c00" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Lock "cinder-quobyte-4b78940b-d017-4097-a255-a55e6dc38c00" acquired by "delete_volume" :: waited 0.044s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f8b2a3-f503-4aed-831f-e98d9d492532]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:53 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e" returned: 0 in 0.502s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-875cdbd2-dc56-4ac2-94f4-c89612a57b6b tempest-VolumesDeleteCascade-96206807 None] Create snapshot completed successfully Sep 25 16:20:53 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 Sep 25 16:20:53 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:53 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00" returned: 0 in 0.598s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:53 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00 Sep 25 16:20:53 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-d3bcac56-1feb-4f7c-b931-b9829e3ab974-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:54 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-d3bcac56-1feb-4f7c-b931-b9829e3ab974-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4b78940b-d017-4097-a255-a55e6dc38c00" returned: 0 in 0.486s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Lock "cinder-quobyte-4b78940b-d017-4097-a255-a55e6dc38c00" released by "delete_volume" :: held 1.159s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Performing cascade delete. {{(pid=87467) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-bf12d021-9101-49b1-b5e2-d478d70cd05e-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-bf12d021-9101-49b1-b5e2-d478d70cd05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Created reservations ['27caad2a-b579-4e67-b8a0-7d20ea2b08a7', '7c02c3cb-bd78-4181-862d-eb1f0764da3a', '15d80908-bdf0-4185-babc-79ce91635d4e', '3d7f9c16-4c8a-4a4b-932a-7c11d7a0068e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-bf12d021-9101-49b1-b5e2-d478d70cd05e" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-bf12d021-9101-49b1-b5e2-d478d70cd05e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Deleting offline snapshot bf12d021-9101-49b1-b5e2-d478d70cd05e of volume d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] snapshot_file for this snap is: volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f22cc4-b520-492a-b973-bc2c6e5e79bc]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:20:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:54 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:20:54 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:54 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e Sep 25 16:20:54 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:55 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:20:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Deleted volume successfully. Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3dff2ad1-a9ef-466e-89c8-1747d35958ab tempest-VolumeQuotasAdminTestJSON-1985259507 None] Lock "cinder-4b78940b-d017-4097-a255-a55e6dc38c00-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:55 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e" returned: 0 in 0.534s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f55c5-4946-4f7c-ab44-37981bd01219]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:55 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 Sep 25 16:20:55 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:55 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" returned: 0 in 0.552s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:55 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e Sep 25 16:20:55 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:56 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e" returned: 0 in 0.763s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:56 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e Sep 25 16:20:56 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:56 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.bf12d021-9101-49b1-b5e2-d478d70cd05e" returned: 0 in 0.496s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-bf12d021-9101-49b1-b5e2-d478d70cd05e" released by "_delete_snapshot" :: held 2.507s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" released by "delete_snapshot" :: held 2.545s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Created reservations ['241dfac3-a636-49ac-9eec-fccd31476e2a', '18731097-3d6a-49c4-9d1b-88863692ddff', 'a8fd7569-f139-4ad4-a1e6-04708134432a', 'd1f87514-815d-4767-b17a-6dad7f2a0b9c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Delete snapshot completed successfully. Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-bf12d021-9101-49b1-b5e2-d478d70cd05e-delete_snapshot" released by "delete_snapshot" :: held 2.896s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Deleting offline snapshot d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 of volume d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] snapshot_file for this snap is: volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[771ad981-b77b-4f96-b914-6f7bec43be52]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:57 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 Sep 25 16:20:57 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:58 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" returned: 0 in 0.500s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:20:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7665eb4f-ced1-498e-a3ec-16dd25c124e7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:58 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 Sep 25 16:20:58 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:58 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974" returned: 0 in 0.497s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:58 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 Sep 25 16:20:58 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:59 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" returned: 0 in 0.466s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:59 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1 Sep 25 16:20:59 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:20:59 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974.d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" returned: 0 in 0.325s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1" released by "_delete_snapshot" :: held 1.978s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" released by "delete_snapshot" :: held 2.017s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Created reservations ['e4822ca9-b8ea-461b-815a-921f522f233f', '4f13d01a-6aee-4d2e-b61e-b687a9186846', 'dae514a5-eeb1-412a-b26a-5ee68d767ffc', '85b45d6c-6410-4f9c-9e21-3433797c5411'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:20:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Delete snapshot completed successfully. Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-d8df951c-8cf6-4f3c-9c6c-556bb6c73ad1-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Snapshots deleted, issuing volume delete {{(pid=87467) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2084035-ee8e-4b37-adbd-a6d14e524f25]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:20:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:20:59 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 Sep 25 16:20:59 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:00 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974" returned: 0 in 0.497s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:00 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974 Sep 25 16:21:00 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:00 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3bcac56-1feb-4f7c-b931-b9829e3ab974" returned: 0 in 0.352s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-d3bcac56-1feb-4f7c-b931-b9829e3ab974" released by "delete_volume" :: held 0.968s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Created reservations ['7fa634f6-4faf-4f39-8704-07c3b2f3347d', '208b7300-7314-4f4e-8bfa-a7906d1a7c45', '479be095-f3c4-4efb-a0a5-62fa02d3ddc8', '5bf6b19f-39f9-47f0-a1b6-6a9c1723e4ba'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:00 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:00 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:01 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.481s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:01 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Deleted volume successfully. Sep 25 16:21:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1fcab7a3-7a66-469e-aa4c-1e27ae5d6245 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-d3bcac56-1feb-4f7c-b931-b9829e3ab974-delete_volume" released by "delete_volume" :: held 7.103s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:02 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Flow 'volume_create_manager' (b34894ea-292b-4e08-bc7e-f5879baa7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef797db-b445-4dca-aa7e-5241b7b15f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef797db-b445-4dca-aa7e-5241b7b15f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1642249031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ca762c-529c-4e49-b382-043755c0887e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be33838d21614221b7aca1dbe91f9e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:03Z,use_quota=True,user_id='9d8dc5b3697c48a7b6d02825820ed1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfafa2c5-f38d-4d38-be99-9aad85099479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfafa2c5-f38d-4d38-be99-9aad85099479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc01c32-1807-4a1b-88a6-c510045e082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc01c32-1807-4a1b-88a6-c510045e082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ca762c-529c-4e49-b382-043755c0887e', 'volume_name': 'volume-e8ca762c-529c-4e49-b382-043755c0887e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80dc079-1129-41a4-a68f-1939ce12d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80dc079-1129-41a4-a68f-1939ce12d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fc8b95-cff0-4333-87fd-c76f70820ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:03 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Volume e8ca762c-529c-4e49-b382-043755c0887e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ca762c-529c-4e49-b382-043755c0887e', 'volume_size': 1} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1642249031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ca762c-529c-4e49-b382-043755c0887e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be33838d21614221b7aca1dbe91f9e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:03Z,use_quota=True,user_id='9d8dc5b3697c48a7b6d02825820ed1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Creating volume e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:03 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:03 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e 1073741824 Sep 25 16:21:03 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:03 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e 1073741824" returned: 0 in 0.816s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:03 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e Sep 25 16:21:03 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:04 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e" returned: 0 in 0.332s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fc8b95-cff0-4333-87fd-c76f70820ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ca762c-529c-4e49-b382-043755c0887e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda57c92-003b-4672-96d8-0143d9f1fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:04 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Volume volume-e8ca762c-529c-4e49-b382-043755c0887e (e8ca762c-529c-4e49-b382-043755c0887e): created successfully Sep 25 16:21:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda57c92-003b-4672-96d8-0143d9f1fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Flow 'volume_create_manager' (b34894ea-292b-4e08-bc7e-f5879baa7abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c4c2c115-10ad-4a16-b65e-c64bde2d37d6 tempest-VolumesDeleteCascade-96206807 None] Created volume successfully. Sep 25 16:21:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Creating offline snapshot 0f48a290-7ce3-4cc7-9980-a037cdaca8a4 of volume e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:21:05 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec6f027-b64d-45e3-8d46-a9b15dd1c404]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:05 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e Sep 25 16:21:05 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:06 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e" returned: 0 in 0.500s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:06 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 1G Sep 25 16:21:06 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:06 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 1G" returned: 0 in 0.566s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ca762c-529c-4e49-b382-043755c0887e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:06 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ca762c-529c-4e49-b382-043755c0887e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 Sep 25 16:21:06 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:06 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8ca762c-529c-4e49-b382-043755c0887e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4" returned: 0 in 0.387s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:06 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 is being set with open permissions: ugo+rw Sep 25 16:21:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:07 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 Sep 25 16:21:07 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:07 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4" returned: 0 in 0.399s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:07 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.info Sep 25 16:21:07 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:07 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.info" returned: 0 in 0.450s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:07 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.info is being set with open permissions: ugo+rw Sep 25 16:21:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:07 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.info Sep 25 16:21:07 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.info" returned: 0 in 0.550s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:08 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:08 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b204ef49-aa27-4427-b2ba-70655449a3f1 tempest-VolumesDeleteCascade-96206807 None] Create snapshot completed successfully Sep 25 16:21:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-f5e77d3e-f23d-4704-8572-aba0750e4d39 req-f11e2205-eda0-4847-b874-5e6f978e15fe tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-f5e77d3e-f23d-4704-8572-aba0750e4d39 req-f11e2205-eda0-4847-b874-5e6f978e15fe tempest-TestStampPattern-1875593839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-f5e77d3e-f23d-4704-8572-aba0750e4d39 req-f11e2205-eda0-4847-b874-5e6f978e15fe tempest-TestStampPattern-1875593839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-f5e77d3e-f23d-4704-8572-aba0750e4d39 req-f11e2205-eda0-4847-b874-5e6f978e15fe tempest-TestStampPattern-1875593839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-ee4b55a4-b377-4059-9219-3466043e1480', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03099ab1-a701-4f1d-8f47-65f68c15a14a', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:21:09 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-f5e77d3e-f23d-4704-8572-aba0750e4d39 req-f11e2205-eda0-4847-b874-5e6f978e15fe tempest-TestStampPattern-1875593839 None] attachment_update completed successfully. Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Flow 'volume_create_manager' (e71566cb-fa13-49ac-9426-8b56c1f172a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66ac2f2-ba8b-4e8f-ad59-19c403160047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66ac2f2-ba8b-4e8f-ad59-19c403160047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101029455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec13dcb-f65a-4308-9e08-95c098a22746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be33838d21614221b7aca1dbe91f9e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f48a290-7ce3-4cc7-9980-a037cdaca8a4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:10Z,use_quota=True,user_id='9d8dc5b3697c48a7b6d02825820ed1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a1ee72-ba5a-4358-8857-d826d38ec8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a1ee72-ba5a-4358-8857-d826d38ec8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7e4701-2e63-45ae-abbc-1c9fefbcdfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7e4701-2e63-45ae-abbc-1c9fefbcdfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ec13dcb-f65a-4308-9e08-95c098a22746', 'volume_name': 'volume-2ec13dcb-f65a-4308-9e08-95c098a22746', 'volume_size': 1, 'snapshot_id': '0f48a290-7ce3-4cc7-9980-a037cdaca8a4'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7629ac82-ed3e-4887-92bc-fc0063ef7e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7629ac82-ed3e-4887-92bc-fc0063ef7e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f1e4fc-65e6-42f8-a771-0e824fe9d347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:10 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Volume 2ec13dcb-f65a-4308-9e08-95c098a22746: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ec13dcb-f65a-4308-9e08-95c098a22746', 'volume_size': 1, 'snapshot_id': '0f48a290-7ce3-4cc7-9980-a037cdaca8a4'} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-0f48a290-7ce3-4cc7-9980-a037cdaca8a4-2ec13dcb-f65a-4308-9e08-95c098a22746" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-0f48a290-7ce3-4cc7-9980-a037cdaca8a4-2ec13dcb-f65a-4308-9e08-95c098a22746" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Creating volume 2ec13dcb-f65a-4308-9e08-95c098a22746 from snapshot 0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-2ec13dcb-f65a-4308-9e08-95c098a22746" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-2ec13dcb-f65a-4308-9e08-95c098a22746" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] snapshot: 0f48a290-7ce3-4cc7-9980-a037cdaca8a4, volume: 2ec13dcb-f65a-4308-9e08-95c098a22746, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9c015-cc4d-4d05-9272-8a47f54dff31]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:10 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 Sep 25 16:21:10 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:11 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4" returned: 0 in 0.885s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8ca762c-529c-4e49-b382-043755c0887e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:11 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b6757c-4d8f-4653-9f48-5358d15b9192]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:11 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e Sep 25 16:21:11 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:12 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e" returned: 0 in 0.634s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:21:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:21:12 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:21:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:12 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 Sep 25 16:21:12 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:15 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:15 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:15 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-464bcba4-23c3-4feb-a316-0e61c5d54485 req-2aeb5993-4b67-4e66-8325-3912063bfc73 tempest-TestStampPattern-1875593839 None] Terminate volume connection completed successfully. Sep 25 16:21:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-464bcba4-23c3-4feb-a316-0e61c5d54485 req-2aeb5993-4b67-4e66-8325-3912063bfc73 tempest-TestStampPattern-1875593839 None] Deleting attachment 03099ab1-a701-4f1d-8f47-65f68c15a14a. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:21:16 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 1.018s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:21:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:21:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:21:25 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=61,cinder:UPDATE=52,cinder:DELETE=7,cinder:INSERT=13 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:25 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=45,cinder:UPDATE=54,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:21:27 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746" returned: 0 in 15.439s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:27 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e, size 1024.00 MB, duration 15.44 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:21:27 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Converted 1024.00 MB image at 66.32 MB/s Sep 25 16:21:27 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 is being set with open permissions: ugo+rw Sep 25 16:21:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:27 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 Sep 25 16:21:27 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:28 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746" returned: 0 in 0.546s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-2ec13dcb-f65a-4308-9e08-95c098a22746" released by "_copy_volume_from_snapshot" :: held 17.674s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-0f48a290-7ce3-4cc7-9980-a037cdaca8a4-2ec13dcb-f65a-4308-9e08-95c098a22746" released by "_create_volume_from_snapshot" :: held 17.795s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.826s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f1e4fc-65e6-42f8-a771-0e824fe9d347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec13dcb-f65a-4308-9e08-95c098a22746', 'volume_size': 1, 'snapshot_id': '0f48a290-7ce3-4cc7-9980-a037cdaca8a4'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5420a3a5-fb84-4b9b-aebc-9f2993f1d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Volume volume-2ec13dcb-f65a-4308-9e08-95c098a22746 (2ec13dcb-f65a-4308-9e08-95c098a22746): created successfully Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5420a3a5-fb84-4b9b-aebc-9f2993f1d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Flow 'volume_create_manager' (e71566cb-fa13-49ac-9426-8b56c1f172a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6efc8725-81e3-41f4-82c1-4c688c9002c8 tempest-VolumesDeleteCascade-96206807 None] Created volume successfully. Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-e8ca762c-529c-4e49-b382-043755c0887e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-e8ca762c-529c-4e49-b382-043755c0887e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Performing cascade delete. {{(pid=87467) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-0f48a290-7ce3-4cc7-9980-a037cdaca8a4-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-0f48a290-7ce3-4cc7-9980-a037cdaca8a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-e8ca762c-529c-4e49-b382-043755c0887e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-e8ca762c-529c-4e49-b382-043755c0887e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-0f48a290-7ce3-4cc7-9980-a037cdaca8a4" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-0f48a290-7ce3-4cc7-9980-a037cdaca8a4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Deleting offline snapshot 0f48a290-7ce3-4cc7-9980-a037cdaca8a4 of volume e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] snapshot_file for this snap is: volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec25fa5b-adde-4b6f-801c-e2176bddd3cb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-ee4b55a4-b377-4059-9219-3466043e1480-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:29 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 Sep 25 16:21:29 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Lock "cinder-ee4b55a4-b377-4059-9219-3466043e1480-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-quobyte-ee4b55a4-b377-4059-9219-3466043e1480" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-ee4b55a4-b377-4059-9219-3466043e1480" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296d17e-b446-43c0-8c34-a2c0d200bf94]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:29 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 Sep 25 16:21:29 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:30 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4" returned: 0 in 0.665s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8ca762c-529c-4e49-b382-043755c0887e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1befbc-e392-4c12-af3a-2c6677031237]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:30 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e Sep 25 16:21:30 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:30 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480" returned: 0 in 0.680s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:30 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480 Sep 25 16:21:30 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:30 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ee4b55a4-b377-4059-9219-3466043e1480" returned: 0 in 0.361s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-ee4b55a4-b377-4059-9219-3466043e1480" released by "delete_volume" :: held 1.114s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:30 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e" returned: 0 in 0.671s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:30 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 Sep 25 16:21:30 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Created reservations ['18ad7343-c075-4f28-97ef-3afe95f96a19', '14bba20e-9291-4367-bed4-b80f6286be01', 'b417a712-10a8-407c-92db-669db35f5e1d', 'ed2d4565-f611-4834-942b-e7111c412120'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:31 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:31 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:31 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4" returned: 0 in 0.480s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:31 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4 Sep 25 16:21:31 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:31 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.427s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Deleted volume successfully. Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0700d13b-9e7e-413e-b017-7fd5ecde04e3 tempest-TestStampPattern-1875593839 None] Lock "cinder-ee4b55a4-b377-4059-9219-3466043e1480-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:31 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e.0f48a290-7ce3-4cc7-9980-a037cdaca8a4" returned: 0 in 0.411s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-0f48a290-7ce3-4cc7-9980-a037cdaca8a4" released by "_delete_snapshot" :: held 2.400s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-e8ca762c-529c-4e49-b382-043755c0887e" released by "delete_snapshot" :: held 2.440s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Created reservations ['004b1362-b1ff-4461-9258-f5c805a2eb9f', '270ef4ad-7717-4967-917c-34430a725f1b', 'efa3204d-427f-49b3-80e3-ad9a9eda4fdb', '55f1c166-5492-4c8d-a13d-efe71e66fc71'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Delete snapshot completed successfully. Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-0f48a290-7ce3-4cc7-9980-a037cdaca8a4-delete_snapshot" released by "delete_snapshot" :: held 2.683s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Snapshots deleted, issuing volume delete {{(pid=87467) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-e8ca762c-529c-4e49-b382-043755c0887e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-e8ca762c-529c-4e49-b382-043755c0887e" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3227edba-1bd8-4d9b-9d75-54f7af04ed0a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:32 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e Sep 25 16:21:32 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-2dc974d1-9eef-45c6-be9a-03724b4dd6a2-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Lock "cinder-2dc974d1-9eef-45c6-be9a-03724b4dd6a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-quobyte-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-quobyte-2dc974d1-9eef-45c6-be9a-03724b4dd6a2" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-2dc974d1-9eef-45c6-be9a-03724b4dd6a2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Deleting offline snapshot 2dc974d1-9eef-45c6-be9a-03724b4dd6a2 of volume c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] snapshot_file for this snap is: volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a19af15-29b5-4b3d-9a19-ac71c7421d95]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:32 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e" returned: 0 in 0.626s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:32 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e Sep 25 16:21:32 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:32 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 Sep 25 16:21:32 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:33 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e8ca762c-529c-4e49-b382-043755c0887e" returned: 0 in 0.406s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-e8ca762c-529c-4e49-b382-043755c0887e" released by "delete_volume" :: held 1.149s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:33 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2" returned: 0 in 0.543s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac18c41-213b-4c76-93c4-929cf7b5b489]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Created reservations ['78679d32-5905-49cb-9848-f8052b21dbf0', 'e2a86bf8-f845-4d01-822a-2ebd7cb4508c', 'c4f5c9de-1ec5-4dbf-9386-9772d8592e0b', '78696690-01fa-4267-9ce5-6466f7dc5748'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:33 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 Sep 25 16:21:33 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:33 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:33 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-2ec13dcb-f65a-4308-9e08-95c098a22746-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-2ec13dcb-f65a-4308-9e08-95c098a22746-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:34 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.719s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Deleted volume successfully. Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "cinder-quobyte-2ec13dcb-f65a-4308-9e08-95c098a22746" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f7586e5f-3dbf-4b9c-8046-11c817d05a69 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-e8ca762c-529c-4e49-b382-043755c0887e-delete_volume" released by "delete_volume" :: held 5.146s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-2ec13dcb-f65a-4308-9e08-95c098a22746" acquired by "delete_volume" :: waited 0.046s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa09de-805a-45f1-a979-3fb8c5defb4a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:34 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" returned: 0 in 1.264s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:34 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 Sep 25 16:21:34 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:34 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 Sep 25 16:21:34 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:35 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2" returned: 0 in 0.685s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:35 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746" returned: 0 in 0.905s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:35 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2 Sep 25 16:21:35 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:35 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746 Sep 25 16:21:35 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:35 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2ec13dcb-f65a-4308-9e08-95c098a22746" returned: 0 in 0.525s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-quobyte-2ec13dcb-f65a-4308-9e08-95c098a22746" released by "delete_volume" :: held 1.528s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:35 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0.2dc974d1-9eef-45c6-be9a-03724b4dd6a2" returned: 0 in 0.751s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-2dc974d1-9eef-45c6-be9a-03724b4dd6a2" released by "_delete_snapshot" :: held 3.517s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" released by "delete_snapshot" :: held 3.571s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Created reservations ['bb06616f-a3e9-4ef2-9659-ab13ed551ee3', 'd42e70df-efb6-4e20-8243-cefd76beff67', '47070e84-98cc-4a62-b66d-319decaa2bab', 'bc0ded22-f028-4238-baaa-b2008d8eaecd'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Created reservations ['0352e892-2761-4f5f-91ac-54a533b908a6', 'f0029ca5-7065-4ec9-aa25-0b836eec5d2f', '8644962e-a5ad-41be-a8a6-db2fc5364619', 'd5c6ac54-b1a6-4663-a01b-e1e03d541e12'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:36 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:36 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Delete snapshot completed successfully. Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-65c53257-28dc-49db-97c3-27cc73f0cf7a tempest-TestStampPattern-1875593839 None] Lock "cinder-2dc974d1-9eef-45c6-be9a-03724b4dd6a2-delete_snapshot" released by "delete_snapshot" :: held 4.137s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:36 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.576s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Deleted volume successfully. Sep 25 16:21:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6da53e83-c56d-447a-b84d-69b8923226b3 tempest-VolumesDeleteCascade-96206807 None] Lock "cinder-2ec13dcb-f65a-4308-9e08-95c098a22746-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Lock "cinder-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Acquiring lock "cinder-quobyte-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4807c-90d1-4708-a52f-6f977d2bf906]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:42 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 Sep 25 16:21:42 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Flow 'volume_create_manager' (de094f2c-bf6a-4426-8c9b-e79ff4b0dc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e998f93-f552-45a1-ab43-fbd5f6595de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e998f93-f552-45a1-ab43-fbd5f6595de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1025044423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ecd407-ed3a-4b19-9b39-bf094e34453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04dea2f5f41149558237d6afbb7dc13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:43Z,use_quota=True,user_id='1de508c567264e51a321884150f7fa1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f27b47-4148-42b0-a464-3f0f1abbaee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f27b47-4148-42b0-a464-3f0f1abbaee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd753e15-7935-4b96-aa1a-df0645afbb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd753e15-7935-4b96-aa1a-df0645afbb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ecd407-ed3a-4b19-9b39-bf094e34453f', 'volume_name': 'volume-00ecd407-ed3a-4b19-9b39-bf094e34453f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2221c9-b86c-4c11-b1f0-8eb01f5e7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2221c9-b86c-4c11-b1f0-8eb01f5e7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b203f297-4615-456e-8aff-8b6d339d7065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Volume 00ecd407-ed3a-4b19-9b39-bf094e34453f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ecd407-ed3a-4b19-9b39-bf094e34453f', 'volume_size': 1} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1025044423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ecd407-ed3a-4b19-9b39-bf094e34453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04dea2f5f41149558237d6afbb7dc13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:43Z,use_quota=True,user_id='1de508c567264e51a321884150f7fa1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Creating volume 00ecd407-ed3a-4b19-9b39-bf094e34453f {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:43 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:43 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f 1073741824 Sep 25 16:21:43 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:43 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" returned: 0 in 0.637s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:43 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0 Sep 25 16:21:43 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:43 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" returned: 0 in 0.435s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Lock "cinder-quobyte-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0" released by "delete_volume" :: held 1.186s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:43 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Created reservations ['bab1cfde-3387-4e83-bc37-09fa886cda5b', '5de958df-968e-44aa-a953-32088339bd77', 'f12553e4-c4c1-4964-b7aa-04dad1569274', 'e003ca04-ac9b-40e2-a52e-72334928f2e5'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:44 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f 1073741824" returned: 0 in 0.901s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:44 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f Sep 25 16:21:44 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:44 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:44 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:44 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:44 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.453s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b203f297-4615-456e-8aff-8b6d339d7065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ecd407-ed3a-4b19-9b39-bf094e34453f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05407e05-108a-434b-a359-1293c1232a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Deleted volume successfully. Sep 25 16:21:44 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Volume volume-00ecd407-ed3a-4b19-9b39-bf094e34453f (00ecd407-ed3a-4b19-9b39-bf094e34453f): created successfully Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05407e05-108a-434b-a359-1293c1232a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Flow 'volume_create_manager' (de094f2c-bf6a-4426-8c9b-e79ff4b0dc8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59f2a548-2ac0-4f48-a27a-c69837588438 tempest-TestStampPattern-1875593839 None] Lock "cinder-c26e7b3c-83a1-49f9-a4ad-fc115eb693e0-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2c891b26-6981-4166-b7aa-156c3e00be4b tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Created volume successfully. Sep 25 16:21:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-9711e570-bd2d-4a39-b0b3-4d9985944647 req-b6e960be-02d5-4d21-835b-20c2e513f258 tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-9711e570-bd2d-4a39-b0b3-4d9985944647 req-b6e960be-02d5-4d21-835b-20c2e513f258 tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-9711e570-bd2d-4a39-b0b3-4d9985944647 req-b6e960be-02d5-4d21-835b-20c2e513f258 tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-9711e570-bd2d-4a39-b0b3-4d9985944647 req-b6e960be-02d5-4d21-835b-20c2e513f258 tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-00ecd407-ed3a-4b19-9b39-bf094e34453f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed4b0b8f-479d-4022-a1e7-a81f2ca049a0', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:21:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-9711e570-bd2d-4a39-b0b3-4d9985944647 req-b6e960be-02d5-4d21-835b-20c2e513f258 tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] attachment_update completed successfully. Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Flow 'volume_create_manager' (b0cb8504-4f69-4271-a710-bb695a6c6642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3230d5-8e0f-4b4e-b0e6-4dbcd6fe6536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3230d5-8e0f-4b4e-b0e6-4dbcd6fe6536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2127786901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313f7cd0-796c-4a7f-b8e6-32ae71b247e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8962766ab65c4b098657f8d780a989bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:48Z,use_quota=True,user_id='74a0c939ff734f43b0d938b3951a72b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d1c345-1cd0-4e52-92de-ebb2f11404d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d1c345-1cd0-4e52-92de-ebb2f11404d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a8883c-707d-451d-a7c9-3903e779f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a8883c-707d-451d-a7c9-3903e779f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313f7cd0-796c-4a7f-b8e6-32ae71b247e0', 'volume_name': 'volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b3a19e-e728-4c7b-b6cd-b52f58e6b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b3a19e-e728-4c7b-b6cd-b52f58e6b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fceed85-17cc-4fe2-ba88-a2f67bfe82e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Volume 313f7cd0-796c-4a7f-b8e6-32ae71b247e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0', 'volume_size': 1} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2127786901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313f7cd0-796c-4a7f-b8e6-32ae71b247e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8962766ab65c4b098657f8d780a989bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:48Z,use_quota=True,user_id='74a0c939ff734f43b0d938b3951a72b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Creating volume 313f7cd0-796c-4a7f-b8e6-32ae71b247e0 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:48 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:21:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:48 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 1073741824 Sep 25 16:21:48 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:49 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 1073741824" returned: 0 in 0.799s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:49 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 Sep 25 16:21:49 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:49 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0" returned: 0 in 0.354s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fceed85-17cc-4fe2-ba88-a2f67bfe82e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8aa046b-fbb8-4c6c-9053-33304f24dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Volume volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 (313f7cd0-796c-4a7f-b8e6-32ae71b247e0): created successfully Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8aa046b-fbb8-4c6c-9053-33304f24dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Flow 'volume_create_manager' (b0cb8504-4f69-4271-a710-bb695a6c6642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b1740b9e-0b1d-452b-a33d-9a2fb9b11bb3 tempest-VolumesTransfersTest-2000757743 None] Created volume successfully. Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Flow 'volume_create_manager' (5772aebe-e5cc-4acd-ad85-baec7d4cccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e03904-ac8a-4263-ac1e-c65b79eec3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e03904-ac8a-4263-ac1e-c65b79eec3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-620025875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d6eaf4-c83d-425a-95ad-ad1215e247b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4871dacc95e4e5187b3e7b502c01f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:51Z,use_quota=True,user_id='c3478e9d20534c839f5cc0fb31c16b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df761c2c-c854-4997-b53b-0b058d5cf521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df761c2c-c854-4997-b53b-0b058d5cf521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27064eea-f992-4506-987b-ebecb7764155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27064eea-f992-4506-987b-ebecb7764155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d6eaf4-c83d-425a-95ad-ad1215e247b8', 'volume_name': 'volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf44794-502a-49e2-bea1-874d381f34c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf44794-502a-49e2-bea1-874d381f34c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943ebb5b-6329-4c02-8e43-66828ed8fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Volume c6d6eaf4-c83d-425a-95ad-ad1215e247b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8', 'volume_size': 1} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-620025875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d6eaf4-c83d-425a-95ad-ad1215e247b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4871dacc95e4e5187b3e7b502c01f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:51Z,use_quota=True,user_id='c3478e9d20534c839f5cc0fb31c16b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Creating volume c6d6eaf4-c83d-425a-95ad-ad1215e247b8 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:21:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:50 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 1073741824 Sep 25 16:21:50 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2b52fe90-b25d-4112-866d-ca44957d6d7f tempest-VolumesTransfersTest-684406967 None] Transfer volume completed successfully. Sep 25 16:21:51 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 1073741824" returned: 0 in 0.900s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:51 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 Sep 25 16:21:51 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:52 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943ebb5b-6329-4c02-8e43-66828ed8fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932d2869-0290-4008-bca4-2affa508f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Volume volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 (c6d6eaf4-c83d-425a-95ad-ad1215e247b8): created successfully Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932d2869-0290-4008-bca4-2affa508f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Flow 'volume_create_manager' (5772aebe-e5cc-4acd-ad85-baec7d4cccc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3658c92b-57e8-4aee-822b-1cbe336e2adc tempest-VolumesListAdminTestJSON-690731313 None] Created volume successfully. Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Acquiring lock "cinder-313f7cd0-796c-4a7f-b8e6-32ae71b247e0-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Lock "cinder-313f7cd0-796c-4a7f-b8e6-32ae71b247e0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Acquiring lock "cinder-quobyte-313f7cd0-796c-4a7f-b8e6-32ae71b247e0" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Lock "cinder-quobyte-313f7cd0-796c-4a7f-b8e6-32ae71b247e0" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[193a0b85-b3b4-4a0e-a46c-7002504ec307]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:53 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 Sep 25 16:21:53 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-cc82fe6a-1ee6-406e-8358-983fd72b2c18 req-f640685b-5761-4d8b-872e-99cfe7dbc075 tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Terminate volume connection completed successfully. Sep 25 16:21:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-cc82fe6a-1ee6-406e-8358-983fd72b2c18 req-f640685b-5761-4d8b-872e-99cfe7dbc075 tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Deleting attachment ed4b0b8f-479d-4022-a1e7-a81f2ca049a0. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:21:53 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0" returned: 0 in 0.558s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:53 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0 Sep 25 16:21:53 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:54 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-313f7cd0-796c-4a7f-b8e6-32ae71b247e0" returned: 0 in 0.462s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Lock "cinder-quobyte-313f7cd0-796c-4a7f-b8e6-32ae71b247e0" released by "delete_volume" :: held 1.108s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Created reservations ['68840391-0a1c-436d-b187-a1294c910930', '2cb03914-dffb-4ec0-b2ec-5e23d283b5e3', '22ce4f06-6ea0-48a0-ab5e-da19c54b8a89', '87c70358-4972-42d5-ad5e-6f0c1f7ac9a1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Flow 'volume_create_manager' (0084c579-2fbb-4c56-a8fe-10c0aea0898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669d0628-dd45-48a8-96cf-c665319cbc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669d0628-dd45-48a8-96cf-c665319cbc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-147218203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dade6aa2-1d56-4b65-976d-4a69cba85d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4871dacc95e4e5187b3e7b502c01f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:54Z,use_quota=True,user_id='c3478e9d20534c839f5cc0fb31c16b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07e9d2e-122b-4dca-b173-7236361d6c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07e9d2e-122b-4dca-b173-7236361d6c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a55935-41e5-4f36-8024-66b1601e9f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a55935-41e5-4f36-8024-66b1601e9f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dade6aa2-1d56-4b65-976d-4a69cba85d25', 'volume_name': 'volume-dade6aa2-1d56-4b65-976d-4a69cba85d25', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf682e5-9ca5-4088-bebd-83e973a8c248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf682e5-9ca5-4088-bebd-83e973a8c248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab0d804-f171-4dad-ae93-bd447bbccdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:54 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Volume dade6aa2-1d56-4b65-976d-4a69cba85d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dade6aa2-1d56-4b65-976d-4a69cba85d25', 'volume_size': 1} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-147218203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dade6aa2-1d56-4b65-976d-4a69cba85d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4871dacc95e4e5187b3e7b502c01f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:54Z,use_quota=True,user_id='c3478e9d20534c839f5cc0fb31c16b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Creating volume dade6aa2-1d56-4b65-976d-4a69cba85d25 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:54 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:54 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 1073741824 Sep 25 16:21:54 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:54 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:54 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:54 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.320s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Deleted volume successfully. Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-57de127e-5352-4f8e-a299-dc90f9de7ffa tempest-VolumesTransfersTest-106997855 None] Lock "cinder-313f7cd0-796c-4a7f-b8e6-32ae71b247e0-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:54 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 1073741824" returned: 0 in 0.629s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:55 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 Sep 25 16:21:55 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Acquiring lock "cinder-00ecd407-ed3a-4b19-9b39-bf094e34453f-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "cinder-00ecd407-ed3a-4b19-9b39-bf094e34453f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Acquiring lock "cinder-quobyte-00ecd407-ed3a-4b19-9b39-bf094e34453f" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "cinder-quobyte-00ecd407-ed3a-4b19-9b39-bf094e34453f" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc098f-f9df-4fe8-921f-4f3bd7f25ae6]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:55 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25" returned: 0 in 0.381s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:55 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f Sep 25 16:21:55 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab0d804-f171-4dad-ae93-bd447bbccdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dade6aa2-1d56-4b65-976d-4a69cba85d25', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e574d2ff-144b-4ae0-9449-05bc6e830928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:55 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Volume volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 (dade6aa2-1d56-4b65-976d-4a69cba85d25): created successfully Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e574d2ff-144b-4ae0-9449-05bc6e830928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Flow 'volume_create_manager' (0084c579-2fbb-4c56-a8fe-10c0aea0898d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-32bd3c12-f3ea-45ef-bc9c-cfc055851ebd tempest-VolumesListAdminTestJSON-690731313 None] Created volume successfully. Sep 25 16:21:55 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f" returned: 0 in 0.534s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:55 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f Sep 25 16:21:55 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Flow 'volume_create_manager' (33e3f07e-cfc4-4863-be16-fa1642e0e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be4b691-9f8a-4550-a7a3-96172ed484a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be4b691-9f8a-4550-a7a3-96172ed484a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1927791130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8962766ab65c4b098657f8d780a989bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:56Z,use_quota=True,user_id='74a0c939ff734f43b0d938b3951a72b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019f2607-5342-451f-b29a-6cd9ce8a84cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019f2607-5342-451f-b29a-6cd9ce8a84cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59be9e7-5727-4df6-9961-8ee4478ec270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59be9e7-5727-4df6-9961-8ee4478ec270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7', 'volume_name': 'volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c2808e-d2b9-438f-9fc4-ece69d64de83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c2808e-d2b9-438f-9fc4-ece69d64de83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1308d0ce-7acd-4be5-9770-ee448282edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Volume 19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7', 'volume_size': 1} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1927791130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8962766ab65c4b098657f8d780a989bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:56Z,use_quota=True,user_id='74a0c939ff734f43b0d938b3951a72b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Creating volume 19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:56 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:56 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 1073741824 Sep 25 16:21:56 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:56 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-00ecd407-ed3a-4b19-9b39-bf094e34453f" returned: 0 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "cinder-quobyte-00ecd407-ed3a-4b19-9b39-bf094e34453f" released by "delete_volume" :: held 0.971s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Created reservations ['daf6b3e8-a374-411a-9766-9e037c0c4204', '45c39596-29a2-4505-95d6-efb9e171cce3', '95ae47f3-8746-4c97-bc4e-ee61321e0c85', '21519d3c-bab4-4d03-af8e-84c83d08720c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:56 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:21:56 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:56 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 1073741824" returned: 0 in 0.660s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:56 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 Sep 25 16:21:56 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:56 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.379s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:21:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Deleted volume successfully. Sep 25 16:21:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf6d302b-6b64-4b45-9b9c-e495f822ed0f tempest-TestServerVolumeAttachScenarioOldVersion-586728699 None] Lock "cinder-00ecd407-ed3a-4b19-9b39-bf094e34453f-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:21:57 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7" returned: 0 in 0.441s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1308d0ce-7acd-4be5-9770-ee448282edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca09298-98d0-4025-ba8b-361f89476b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Flow 'volume_create_manager' (b7a64f01-ab98-43a9-a005-c32b39821f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b041231-71c1-4bfd-8bcd-9bc1fba6c306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Volume volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 (19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7): created successfully Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca09298-98d0-4025-ba8b-361f89476b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Flow 'volume_create_manager' (33e3f07e-cfc4-4863-be16-fa1642e0e86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b041231-71c1-4bfd-8bcd-9bc1fba6c306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-670652456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebccaf65-8b85-4112-93d3-16e3a2691a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4871dacc95e4e5187b3e7b502c01f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:57Z,use_quota=True,user_id='c3478e9d20534c839f5cc0fb31c16b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1497615-76bf-4a0c-80ab-ca96e8e9918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1497615-76bf-4a0c-80ab-ca96e8e9918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa655a9-01a3-4f0f-8f5b-c7668bb9ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa655a9-01a3-4f0f-8f5b-c7668bb9ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebccaf65-8b85-4112-93d3-16e3a2691a93', 'volume_name': 'volume-ebccaf65-8b85-4112-93d3-16e3a2691a93', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffbe3dd-6609-495c-84b5-b88e9860c375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffbe3dd-6609-495c-84b5-b88e9860c375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8729c9-1f45-4ccb-a59d-31fdf6554710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Volume ebccaf65-8b85-4112-93d3-16e3a2691a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebccaf65-8b85-4112-93d3-16e3a2691a93', 'volume_size': 1} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-670652456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebccaf65-8b85-4112-93d3-16e3a2691a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4871dacc95e4e5187b3e7b502c01f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:21:57Z,use_quota=True,user_id='c3478e9d20534c839f5cc0fb31c16b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Creating volume ebccaf65-8b85-4112-93d3-16e3a2691a93 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:21:57 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:21:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-93dccfc4-97a4-4a19-8d74-8a75b5ebb7b2 tempest-VolumesTransfersTest-2000757743 None] Created volume successfully. Sep 25 16:21:57 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 1073741824 Sep 25 16:21:57 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:58 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 1073741824" returned: 0 in 0.708s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:58 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 Sep 25 16:21:58 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Acquiring lock "cinder-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:58 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Lock "cinder-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93" returned: 0 in 0.600s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8729c9-1f45-4ccb-a59d-31fdf6554710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebccaf65-8b85-4112-93d3-16e3a2691a93', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc21cc8f-5d94-4c4c-b344-4aac5e1c1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:21:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Volume volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 (ebccaf65-8b85-4112-93d3-16e3a2691a93): created successfully Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc21cc8f-5d94-4c4c-b344-4aac5e1c1c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Flow 'volume_create_manager' (b7a64f01-ab98-43a9-a005-c32b39821f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Acquiring lock "cinder-quobyte-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:21:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9e937455-6a39-4b58-bd63-d483637368a3 tempest-VolumesListAdminTestJSON-690731313 None] Created volume successfully. Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Lock "cinder-quobyte-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[04794e2f-062a-4131-8b42-473866dfcf7f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:21:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:59 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 Sep 25 16:21:59 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:59 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7" returned: 0 in 0.627s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:21:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:21:59 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7 Sep 25 16:21:59 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:21:59 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 25 16:21:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7" returned: 0 in 0.403s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Lock "cinder-quobyte-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7" released by "delete_volume" :: held 1.104s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Created reservations ['6bb1c21a-afc7-4a9d-8697-63f075be075c', '07616624-7864-4564-970a-1e0c0aff43ae', 'dc67f80b-157d-4165-9742-4ab413daea39', '9e0e1d28-3a15-4a75-abd8-9358f1610bbf'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:00 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:00 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:00 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.422s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Flow 'volume_create_manager' (328cf47c-cfbd-4ccd-a5af-2e2a8b385a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9d9768-2f92-405a-ae45-d890fccb8e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Deleted volume successfully. Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9d9768-2f92-405a-ae45-d890fccb8e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c31cb48-bc1e-470b-902a-5ead9a9c9197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32db5e997e0b4e0e86dc9ef617204be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:01Z,use_quota=True,user_id='4469f5cc700f4747a8c02e1b31d5a3a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ebc4c7-8b04-4352-a1b7-d6f8cd95c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ebc4c7-8b04-4352-a1b7-d6f8cd95c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6048086-1b28-451d-a955-e51dc63a2e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6048086-1b28-451d-a955-e51dc63a2e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c31cb48-bc1e-470b-902a-5ead9a9c9197', 'volume_name': 'volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19aa9709-efa0-490c-be1f-99f181e23c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19aa9709-efa0-490c-be1f-99f181e23c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12d9fbd-92a5-4637-80be-82cdaba697b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:00 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Volume 2c31cb48-bc1e-470b-902a-5ead9a9c9197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197', 'volume_size': 1} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c31cb48-bc1e-470b-902a-5ead9a9c9197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32db5e997e0b4e0e86dc9ef617204be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:01Z,use_quota=True,user_id='4469f5cc700f4747a8c02e1b31d5a3a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Creating volume 2c31cb48-bc1e-470b-902a-5ead9a9c9197 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:00 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c0807669-30e1-4337-a3e1-ba61dabf4ff1 tempest-VolumesTransfersTest-106997855 None] Lock "cinder-19d1f5c1-407a-4b8e-bb74-8c8f44bdc2a7-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:00 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 1073741824 Sep 25 16:22:00 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:01 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 1073741824" returned: 0 in 0.916s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:01 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 Sep 25 16:22:01 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:02 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197" returned: 0 in 0.400s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12d9fbd-92a5-4637-80be-82cdaba697b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aaa0ba-51cd-40d1-8175-f181cea4d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:02 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Volume volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 (2c31cb48-bc1e-470b-902a-5ead9a9c9197): created successfully Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aaa0ba-51cd-40d1-8175-f181cea4d997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Flow 'volume_create_manager' (328cf47c-cfbd-4ccd-a5af-2e2a8b385a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:02 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a7c519c0-7b2f-45e1-946e-afc431262359 tempest-VolumesListAdminTestJSON-1160739325 None] Created volume successfully. Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Acquiring lock "cinder-2c31cb48-bc1e-470b-902a-5ead9a9c9197-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "cinder-2c31cb48-bc1e-470b-902a-5ead9a9c9197-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Acquiring lock "cinder-quobyte-2c31cb48-bc1e-470b-902a-5ead9a9c9197" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "cinder-quobyte-2c31cb48-bc1e-470b-902a-5ead9a9c9197" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac740d2-afd8-40f3-8c44-c33b5c4d4af2]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "cinder-ebccaf65-8b85-4112-93d3-16e3a2691a93-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-ebccaf65-8b85-4112-93d3-16e3a2691a93-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "cinder-quobyte-ebccaf65-8b85-4112-93d3-16e3a2691a93" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-quobyte-ebccaf65-8b85-4112-93d3-16e3a2691a93" acquired by "delete_volume" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3fea2-122c-498a-a110-843e01049d91]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:03 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 Sep 25 16:22:03 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:03 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 Sep 25 16:22:03 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:03 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197" returned: 0 in 0.824s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:04 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197 Sep 25 16:22:04 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:04 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93" returned: 0 in 0.605s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:04 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93 Sep 25 16:22:04 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:04 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2c31cb48-bc1e-470b-902a-5ead9a9c9197" returned: 0 in 0.391s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "cinder-quobyte-2c31cb48-bc1e-470b-902a-5ead9a9c9197" released by "delete_volume" :: held 1.315s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Created reservations ['89f451a8-d145-4477-b992-96866c312e30', 'bf6e9ae6-ca25-425e-8ec5-ba9a76c86fdc', '0c85a3bb-7b8b-47af-a948-7cb0984e4226', '135c9eb1-b4fa-4220-bf65-044395928d3e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:04 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ebccaf65-8b85-4112-93d3-16e3a2691a93" returned: 0 in 0.512s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-quobyte-ebccaf65-8b85-4112-93d3-16e3a2691a93" released by "delete_volume" :: held 1.220s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:04 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:04 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Created reservations ['ec792d60-cdf8-4e0a-a9e6-47168113dbb8', '488cf586-0f12-437e-900e-9eea7f8641b7', 'c6931867-e2bd-49d4-8308-2549b90c658d', '1ee89fed-a516-43e1-b373-adb332ed487e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:04 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:04 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:05 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.383s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Deleted volume successfully. Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5feef2b5-94df-4cd6-add7-b39668d91267 tempest-VolumesListAdminTestJSON-1160739325 None] Lock "cinder-2c31cb48-bc1e-470b-902a-5ead9a9c9197-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:05 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.443s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Deleted volume successfully. Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae75ba56-7ab3-4100-9953-a1c736d35b3f tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-ebccaf65-8b85-4112-93d3-16e3a2691a93-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "cinder-dade6aa2-1d56-4b65-976d-4a69cba85d25-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-dade6aa2-1d56-4b65-976d-4a69cba85d25-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "cinder-quobyte-dade6aa2-1d56-4b65-976d-4a69cba85d25" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-quobyte-dade6aa2-1d56-4b65-976d-4a69cba85d25" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d45b1e-1ffd-48c3-9f22-c6758b362547]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:06 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 Sep 25 16:22:06 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:06 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25" returned: 0 in 0.648s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:06 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25 Sep 25 16:22:06 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:06 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-dade6aa2-1d56-4b65-976d-4a69cba85d25" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-quobyte-dade6aa2-1d56-4b65-976d-4a69cba85d25" released by "delete_volume" :: held 1.143s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Created reservations ['c05c1e78-4348-425f-a728-1897b7f031d3', 'bb326511-35ff-4b04-bddb-0ada76a2af00', 'c340b5a1-60fa-46cf-a015-52093a6defc8', 'f611d54c-e720-4d65-8529-21306324f5f4'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:07 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:07 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:07 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.374s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:07 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Deleted volume successfully. Sep 25 16:22:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5e4d25d6-ef90-4524-b35a-ab865c930df8 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-dade6aa2-1d56-4b65-976d-4a69cba85d25-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "cinder-c6d6eaf4-c83d-425a-95ad-ad1215e247b8-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-c6d6eaf4-c83d-425a-95ad-ad1215e247b8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "cinder-quobyte-c6d6eaf4-c83d-425a-95ad-ad1215e247b8" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-quobyte-c6d6eaf4-c83d-425a-95ad-ad1215e247b8" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f065b3f-382d-4a2a-8b5a-899ece021ea8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:08 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 Sep 25 16:22:08 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:08 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8" returned: 0 in 0.523s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:08 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8 Sep 25 16:22:08 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:09 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6d6eaf4-c83d-425a-95ad-ad1215e247b8" returned: 0 in 0.441s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-quobyte-c6d6eaf4-c83d-425a-95ad-ad1215e247b8" released by "delete_volume" :: held 1.059s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Created reservations ['bf0dbb99-fb17-4f07-8d2e-f5bee692e4ae', '185b386c-7644-4894-9c8d-922e4c86715e', '14a69ab0-e8a9-43f2-9a13-07994e52489d', '90d7ad62-58c1-4787-be05-3b570b7dfda4'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:09 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:09 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:09 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.308s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:09 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Deleted volume successfully. Sep 25 16:22:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c14889a5-439b-46e6-8917-3319113103c2 tempest-VolumesListAdminTestJSON-690731313 None] Lock "cinder-c6d6eaf4-c83d-425a-95ad-ad1215e247b8-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Flow 'volume_create_manager' (17d344d4-07f0-4e6f-a53d-e01905f388ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedbcf4a-0adb-4671-ac45-96c7332d8e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedbcf4a-0adb-4671-ac45-96c7332d8e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1382863363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbed8c9a-2282-4317-a8f4-96dbec4eaf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879a87a22e5e4d9d8f6887bce40cef29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:15Z,use_quota=True,user_id='d9656c8575844610a34ad31a513ca0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bc70a1-46e0-4d8e-92d3-1b3f4041159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bc70a1-46e0-4d8e-92d3-1b3f4041159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb244d25-3cd0-43d6-81c5-3e1613f07fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb244d25-3cd0-43d6-81c5-3e1613f07fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbed8c9a-2282-4317-a8f4-96dbec4eaf28', 'volume_name': 'volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f37c2d5-4102-4094-acda-3c1704e4cbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f37c2d5-4102-4094-acda-3c1704e4cbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c2a720-c8d6-421b-a6d4-b71087c798b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:14 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Volume cbed8c9a-2282-4317-a8f4-96dbec4eaf28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28', 'volume_size': 1} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1382863363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbed8c9a-2282-4317-a8f4-96dbec4eaf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879a87a22e5e4d9d8f6887bce40cef29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:15Z,use_quota=True,user_id='d9656c8575844610a34ad31a513ca0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Creating volume cbed8c9a-2282-4317-a8f4-96dbec4eaf28 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:14 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:14 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 1073741824 Sep 25 16:22:14 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:15 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:15 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:15 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 1073741824" returned: 0 in 0.743s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:15 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 Sep 25 16:22:15 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:15 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.461s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:22:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:22:16 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28" returned: 0 in 0.396s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c2a720-c8d6-421b-a6d4-b71087c798b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14e044c-f13a-4ed3-8e42-96b6cfcfd699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:16 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Volume volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 (cbed8c9a-2282-4317-a8f4-96dbec4eaf28): created successfully Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14e044c-f13a-4ed3-8e42-96b6cfcfd699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Flow 'volume_create_manager' (17d344d4-07f0-4e6f-a53d-e01905f388ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c315c3ca-3efc-487d-b89f-8fad38e5aa45 tempest-VolumesTransfersV355Test-1854596076 None] Created volume successfully. Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (69413794-6ac1-4111-8477-0e49ff1509f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb81fb5-6c99-4981-9af1-0751c752c306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb81fb5-6c99-4981-9af1-0751c752c306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832002781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f67c76-ef45-4d5e-83c5-82afc5e13cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:16Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead26f8e-ec2a-4db0-a58d-8ba7a5365258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead26f8e-ec2a-4db0-a58d-8ba7a5365258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4464de-408e-4aa4-a0f3-c6670d513571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4464de-408e-4aa4-a0f3-c6670d513571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f67c76-ef45-4d5e-83c5-82afc5e13cc0', 'volume_name': 'volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8230459-d0b9-4547-87b3-8f08a0940821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8230459-d0b9-4547-87b3-8f08a0940821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b07eee-a5a9-446d-b7bf-60906f728fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:16 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Volume 21f67c76-ef45-4d5e-83c5-82afc5e13cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0', 'volume_size': 1} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832002781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f67c76-ef45-4d5e-83c5-82afc5e13cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:16Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Creating volume 21f67c76-ef45-4d5e-83c5-82afc5e13cc0 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:16 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:16 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 1073741824 Sep 25 16:22:16 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:16 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 1073741824" returned: 0 in 0.697s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:17 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 Sep 25 16:22:17 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:17 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0" returned: 0 in 0.364s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b07eee-a5a9-446d-b7bf-60906f728fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c8d98a-4b9a-4583-a075-ab30ff47683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Volume volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 (21f67c76-ef45-4d5e-83c5-82afc5e13cc0): created successfully Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c8d98a-4b9a-4583-a075-ab30ff47683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (69413794-6ac1-4111-8477-0e49ff1509f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a408a60b-208f-49b0-bdf7-140176f9808e tempest-ProjectReaderTests-1811113895 None] Created volume successfully. Sep 25 16:22:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0d25d9b6-50d0-4a83-9050-3a23c74cbdd9 tempest-VolumesTransfersV355Test-1369263839 None] Transfer volume completed successfully. Sep 25 16:22:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-21f67c76-ef45-4d5e-83c5-82afc5e13cc0-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-21f67c76-ef45-4d5e-83c5-82afc5e13cc0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-quobyte-21f67c76-ef45-4d5e-83c5-82afc5e13cc0" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-21f67c76-ef45-4d5e-83c5-82afc5e13cc0" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe799c-d51d-4f14-81e4-ebc440e225b7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Acquiring lock "cinder-cbed8c9a-2282-4317-a8f4-96dbec4eaf28-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-cbed8c9a-2282-4317-a8f4-96dbec4eaf28-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Acquiring lock "cinder-quobyte-cbed8c9a-2282-4317-a8f4-96dbec4eaf28" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-quobyte-cbed8c9a-2282-4317-a8f4-96dbec4eaf28" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:19 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 Sep 25 16:22:19 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[007a70e7-f792-44d4-af30-a486672d154c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 Sep 25 16:22:19 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0" returned: 0 in 0.558s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0 Sep 25 16:22:19 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:19 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28" returned: 0 in 0.442s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:19 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28 Sep 25 16:22:19 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:20 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-21f67c76-ef45-4d5e-83c5-82afc5e13cc0" returned: 0 in 0.357s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-21f67c76-ef45-4d5e-83c5-82afc5e13cc0" released by "delete_volume" :: held 0.992s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Created reservations ['56a5e5ab-196f-4794-af4c-df9cc7a8f087', '56f1229e-b71c-4ae0-a2b0-7670f103c039', 'd71679d6-1c73-4c5a-a8bc-68e5553bf35f', '26e7edae-1dfb-4c61-bee5-efd1620aaf9b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:20 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cbed8c9a-2282-4317-a8f4-96dbec4eaf28" returned: 0 in 0.370s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-quobyte-cbed8c9a-2282-4317-a8f4-96dbec4eaf28" released by "delete_volume" :: held 0.894s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Created reservations ['76776e7c-63d7-40a5-a614-ce8a78a1b42e', 'e76c1f04-e36d-42c3-a639-f38ac07b0a15', '91b602be-0918-47f8-8441-4fb69c94234a', 'c4253afd-2097-4d3b-a008-a6aafcc9d30c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:20 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:20 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:20 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:20 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:20 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.360s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Deleted volume successfully. Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-484e69d3-c7bf-456d-9612-2d5f54fe33ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-21f67c76-ef45-4d5e-83c5-82afc5e13cc0-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:20 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Deleted volume successfully. Sep 25 16:22:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a1c125a-3cdc-4c8e-8e7e-59ce5af171ce tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-cbed8c9a-2282-4317-a8f4-96dbec4eaf28-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (f72d0d2f-5737-42ca-8192-d2930d9c0cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf63dfb-b435-4e16-97ef-fe661d958036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf63dfb-b435-4e16-97ef-fe661d958036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144207624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d354bf7-4822-4c2c-ac68-55bb4ba69a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:22Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c8b0ae-39c5-4775-8784-28b3f149cb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c8b0ae-39c5-4775-8784-28b3f149cb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abddaa50-d5da-448e-933d-37b5e24d66fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abddaa50-d5da-448e-933d-37b5e24d66fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d354bf7-4822-4c2c-ac68-55bb4ba69a55', 'volume_name': 'volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716dd1d3-b88a-4f6e-b587-379c6eed064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716dd1d3-b88a-4f6e-b587-379c6eed064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23acfc57-16d5-4085-9e9b-1e7aa67c8ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:22 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Volume 3d354bf7-4822-4c2c-ac68-55bb4ba69a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55', 'volume_size': 1} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144207624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d354bf7-4822-4c2c-ac68-55bb4ba69a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:22Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Creating volume 3d354bf7-4822-4c2c-ac68-55bb4ba69a55 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:22 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:22 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 1073741824 Sep 25 16:22:22 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Flow 'volume_create_manager' (4660d281-027f-4472-b3e9-b22871d2d493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43be499b-cb09-45db-8591-91a402169dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43be499b-cb09-45db-8591-91a402169dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1549810343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b9b410-9775-42a1-b6ee-cc6727a834b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879a87a22e5e4d9d8f6887bce40cef29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:22Z,use_quota=True,user_id='d9656c8575844610a34ad31a513ca0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d84955-8d68-411a-92af-f20bee76b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d84955-8d68-411a-92af-f20bee76b38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fa4d98-7dd7-4ae2-a75b-352133d08b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fa4d98-7dd7-4ae2-a75b-352133d08b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b9b410-9775-42a1-b6ee-cc6727a834b2', 'volume_name': 'volume-77b9b410-9775-42a1-b6ee-cc6727a834b2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0833569-efb9-43be-88c0-14c5629ab1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0833569-efb9-43be-88c0-14c5629ab1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2699dd-6a3c-497a-bd6f-ac93fad52f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:22 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Volume 77b9b410-9775-42a1-b6ee-cc6727a834b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b9b410-9775-42a1-b6ee-cc6727a834b2', 'volume_size': 1} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:22 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 1073741824" returned: 0 in 0.818s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:22 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 Sep 25 16:22:22 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:23 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55" returned: 0 in 0.338s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1549810343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b9b410-9775-42a1-b6ee-cc6727a834b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879a87a22e5e4d9d8f6887bce40cef29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:22Z,use_quota=True,user_id='d9656c8575844610a34ad31a513ca0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Creating volume 77b9b410-9775-42a1-b6ee-cc6727a834b2 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:23 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23acfc57-16d5-4085-9e9b-1e7aa67c8ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:23 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 1073741824 Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12074a17-21bc-4aeb-9824-0e3b6a2cb444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:23 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:23 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Volume volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 (3d354bf7-4822-4c2c-ac68-55bb4ba69a55): created successfully Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12074a17-21bc-4aeb-9824-0e3b6a2cb444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (f72d0d2f-5737-42ca-8192-d2930d9c0cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-425d84d1-d1d1-47ea-8731-cbddece69fdc tempest-ProjectReaderTests-1811113895 None] Created volume successfully. Sep 25 16:22:23 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 1073741824" returned: 0 in 0.554s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:23 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 Sep 25 16:22:23 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-3d354bf7-4822-4c2c-ac68-55bb4ba69a55-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-3d354bf7-4822-4c2c-ac68-55bb4ba69a55-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:24 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-quobyte-3d354bf7-4822-4c2c-ac68-55bb4ba69a55" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2" returned: 0 in 0.445s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2699dd-6a3c-497a-bd6f-ac93fad52f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b9b410-9775-42a1-b6ee-cc6727a834b2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d122801-97a1-41a4-ba26-a158fcd8ac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-3d354bf7-4822-4c2c-ac68-55bb4ba69a55" acquired by "delete_volume" :: waited 0.041s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:24 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Volume volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 (77b9b410-9775-42a1-b6ee-cc6727a834b2): created successfully Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d122801-97a1-41a4-ba26-a158fcd8ac0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Flow 'volume_create_manager' (4660d281-027f-4472-b3e9-b22871d2d493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2ae71b-06be-4103-95d1-80273294dd9d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b95cb1c4-2324-42a5-8c0d-31d61603b8dd tempest-VolumesTransfersV355Test-1854596076 None] Created volume successfully. Sep 25 16:22:24 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 Sep 25 16:22:24 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Acquiring lock "cinder-77b9b410-9775-42a1-b6ee-cc6727a834b2-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-77b9b410-9775-42a1-b6ee-cc6727a834b2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:25 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Acquiring lock "cinder-quobyte-77b9b410-9775-42a1-b6ee-cc6727a834b2" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55" returned: 0 in 0.666s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-quobyte-77b9b410-9775-42a1-b6ee-cc6727a834b2" acquired by "delete_volume" :: waited 0.036s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:25 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55 Sep 25 16:22:25 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4bac61-bb7b-489c-8537-de703f6b15b3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:25 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 Sep 25 16:22:25 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Flow 'volume_create_manager' (f20d448e-ed94-47b4-ad4f-197caa9b6977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1511afb-0dd6-4069-9800-f0126ea907cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1511afb-0dd6-4069-9800-f0126ea907cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2039381167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a07b0dd-984d-478a-9ae4-72f5071bba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226fad2a808949e898ed9f781193471d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:25Z,use_quota=True,user_id='8f1a95fae3df4be5b1d980d610c86ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30454b28-799c-4ae8-814f-015088765a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30454b28-799c-4ae8-814f-015088765a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0c2e3b-71b1-41ae-a62a-1006d6a4a088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0c2e3b-71b1-41ae-a62a-1006d6a4a088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a07b0dd-984d-478a-9ae4-72f5071bba51', 'volume_name': 'volume-3a07b0dd-984d-478a-9ae4-72f5071bba51', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbafde2-9be9-4fa4-b5cc-6c5e406263b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbafde2-9be9-4fa4-b5cc-6c5e406263b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e206e1d-f21b-44e4-85ec-ed2dd58c2de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Volume 3a07b0dd-984d-478a-9ae4-72f5071bba51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a07b0dd-984d-478a-9ae4-72f5071bba51', 'volume_size': 1} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2039381167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a07b0dd-984d-478a-9ae4-72f5071bba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226fad2a808949e898ed9f781193471d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:25Z,use_quota=True,user_id='8f1a95fae3df4be5b1d980d610c86ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Creating volume 3a07b0dd-984d-478a-9ae4-72f5071bba51 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:25 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 1073741824 Sep 25 16:22:25 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3d354bf7-4822-4c2c-ac68-55bb4ba69a55" returned: 0 in 0.430s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-3d354bf7-4822-4c2c-ac68-55bb4ba69a55" released by "delete_volume" :: held 1.181s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Created reservations ['8c67f950-1bc5-4964-9a85-ba2ed87759a0', 'e0444a86-8d54-4600-9a7d-62147b00ed2d', '67372b80-4f27-4a39-b8f1-f913c446c59a', '3adbc122-3cd4-4994-866c-5ae9393c2332'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:25 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2" returned: 0 in 0.564s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:25 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2 Sep 25 16:22:25 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:25 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:25 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:26 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 1073741824" returned: 0 in 0.692s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=135,cinder:INSERT=34,cinder:UPDATE=151,cinder:DELETE=12 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=173,cinder:DELETE=13,cinder:SELECT=97,cinder:INSERT=42 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:26 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-77b9b410-9775-42a1-b6ee-cc6727a834b2" returned: 0 in 0.484s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 Sep 25 16:22:26 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:26 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-quobyte-77b9b410-9775-42a1-b6ee-cc6727a834b2" released by "delete_volume" :: held 1.136s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.493s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Deleted volume successfully. Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-eec63315-2ef2-4ca1-b7ad-03391758e6ea tempest-ProjectReaderTests-1811113895 None] Lock "cinder-3d354bf7-4822-4c2c-ac68-55bb4ba69a55-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Created reservations ['8c81c041-1c5e-4145-9d86-edbebbfe053b', '47fc23fb-a73d-4ede-a778-28f45445f4da', '35932d28-3d31-4328-8d76-0a3b835649d1', '79939b87-9de3-4d88-bd64-30f9dcaeac33'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:26 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:26 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:26 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51" returned: 0 in 0.443s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e206e1d-f21b-44e4-85ec-ed2dd58c2de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a07b0dd-984d-478a-9ae4-72f5071bba51', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78105b60-3217-4fc2-a9e4-fd9a2b2c71bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:26 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Volume volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 (3a07b0dd-984d-478a-9ae4-72f5071bba51): created successfully Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78105b60-3217-4fc2-a9e4-fd9a2b2c71bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Flow 'volume_create_manager' (f20d448e-ed94-47b4-ad4f-197caa9b6977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8d353fc6-6c58-4995-93aa-dc1d3f905c67 tempest-AbsoluteLimitsTests-123513708 None] Created volume successfully. Sep 25 16:22:26 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.373s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Deleted volume successfully. Sep 25 16:22:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-332fe304-a209-4448-8256-c923f8cab30a tempest-VolumesTransfersV355Test-1623190830 None] Lock "cinder-77b9b410-9775-42a1-b6ee-cc6727a834b2-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (cc603e30-81cb-407e-8ecf-31cd4c351aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d23ae-8ecc-4dd1-8fc6-1e6b813385d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d23ae-8ecc-4dd1-8fc6-1e6b813385d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784419116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cd4042-ba94-4b0d-8d29-1c997b3c62b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:27Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e6a609-e85b-4016-b7db-eaa669d672d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e6a609-e85b-4016-b7db-eaa669d672d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da20ed5-283e-45dc-b821-068c3b1c1640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da20ed5-283e-45dc-b821-068c3b1c1640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73cd4042-ba94-4b0d-8d29-1c997b3c62b8', 'volume_name': 'volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a903cfa7-fa60-429d-b3dc-2a7b2d670513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a903cfa7-fa60-429d-b3dc-2a7b2d670513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093265fe-8056-46b6-bd84-be6fd46b955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Volume 73cd4042-ba94-4b0d-8d29-1c997b3c62b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8', 'volume_size': 1} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784419116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cd4042-ba94-4b0d-8d29-1c997b3c62b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:27Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Creating volume 73cd4042-ba94-4b0d-8d29-1c997b3c62b8 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:27 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:27 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 1073741824 Sep 25 16:22:27 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Acquiring lock "cinder-3a07b0dd-984d-478a-9ae4-72f5071bba51-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Lock "cinder-3a07b0dd-984d-478a-9ae4-72f5071bba51-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Acquiring lock "cinder-quobyte-3a07b0dd-984d-478a-9ae4-72f5071bba51" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Lock "cinder-quobyte-3a07b0dd-984d-478a-9ae4-72f5071bba51" acquired by "delete_volume" :: waited 0.036s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b356565-e8c9-46c7-b041-2085327de963]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 1073741824" returned: 0 in 0.937s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:28 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 Sep 25 16:22:28 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 Sep 25 16:22:28 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:28 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51" returned: 0 in 0.603s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:28 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51 Sep 25 16:22:28 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:28 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8" returned: 0 in 0.413s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093265fe-8056-46b6-bd84-be6fd46b955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9291f649-851a-4bf4-b8fb-b46009d44103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Volume volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 (73cd4042-ba94-4b0d-8d29-1c997b3c62b8): created successfully Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9291f649-851a-4bf4-b8fb-b46009d44103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (cc603e30-81cb-407e-8ecf-31cd4c351aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2297863c-b350-4e26-800f-6707b3d44a37 tempest-ProjectReaderTests-1811113895 None] Created volume successfully. Sep 25 16:22:29 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3a07b0dd-984d-478a-9ae4-72f5071bba51" returned: 0 in 0.376s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Lock "cinder-quobyte-3a07b0dd-984d-478a-9ae4-72f5071bba51" released by "delete_volume" :: held 1.074s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Created reservations ['8706fa64-e820-4cbf-a33a-d1b581616388', 'e6470909-4212-4910-a2ac-f830cfab95d1', 'ba93e614-05f3-4b3a-9d2e-c7987d68579e', 'e07750b2-2413-4e15-a9ac-022ecd5a7bda'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-73cd4042-ba94-4b0d-8d29-1c997b3c62b8-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:29 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:29 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Lock "cinder-73cd4042-ba94-4b0d-8d29-1c997b3c62b8-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-quobyte-73cd4042-ba94-4b0d-8d29-1c997b3c62b8" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-73cd4042-ba94-4b0d-8d29-1c997b3c62b8" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed7970c-059f-49fa-b75a-f616f8c48c54]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:29 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.338s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Deleted volume successfully. Sep 25 16:22:29 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 Sep 25 16:22:29 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-15f67d61-7731-436f-90ad-a05ee7423471 tempest-AbsoluteLimitsTests-123513708 None] Lock "cinder-3a07b0dd-984d-478a-9ae4-72f5071bba51-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:30 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8" returned: 0 in 0.541s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:30 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8 Sep 25 16:22:30 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:30 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-73cd4042-ba94-4b0d-8d29-1c997b3c62b8" returned: 0 in 0.382s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-73cd4042-ba94-4b0d-8d29-1c997b3c62b8" released by "delete_volume" :: held 1.001s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Created reservations ['42a6282c-f42a-4ec0-9845-9fa985dfa072', '6a618562-6aa1-499d-b566-808d906043c0', '00e59eaf-6447-49ee-a197-568d4e29a748', 'c5bcfbdc-6e03-4f53-9aef-95326a045d1e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:30 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:30 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:31 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.582s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Deleted volume successfully. Sep 25 16:22:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5652f0c4-6b39-4e57-a84c-a41d403c4d1d tempest-ProjectReaderTests-1811113895 None] Lock "cinder-73cd4042-ba94-4b0d-8d29-1c997b3c62b8-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (4de4fbf8-aec6-4803-a9d3-5f83d95d31b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7ce4d7-ddb0-4b74-8d27-d3572052a98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7ce4d7-ddb0-4b74-8d27-d3572052a98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158432697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac41cf6-0455-4418-b67f-3f39ce9d8c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:33Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66b4efe-b199-4e6e-9b59-f969db3cb8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66b4efe-b199-4e6e-9b59-f969db3cb8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d72882b-1418-4d4d-b11d-0ab1daa01fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d72882b-1418-4d4d-b11d-0ab1daa01fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac41cf6-0455-4418-b67f-3f39ce9d8c35', 'volume_name': 'volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dcc7c5-14fa-4d14-a969-f256e70b85c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dcc7c5-14fa-4d14-a969-f256e70b85c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a75ed6-c72b-47a3-ae62-158ae5791094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:32 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Volume 0ac41cf6-0455-4418-b67f-3f39ce9d8c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35', 'volume_size': 1} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158432697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac41cf6-0455-4418-b67f-3f39ce9d8c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f00ffd84d94c7b88a7d453af23dca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:33Z,use_quota=True,user_id='48e0066df57e496abef843ef2f775983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Creating volume 0ac41cf6-0455-4418-b67f-3f39ce9d8c35 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:32 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:32 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 1073741824 Sep 25 16:22:32 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:33 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 1073741824" returned: 0 in 0.692s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:33 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 Sep 25 16:22:33 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:33 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35" returned: 0 in 0.430s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a75ed6-c72b-47a3-ae62-158ae5791094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a40ad2-e37c-4e99-a36f-0bd6de47001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:33 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Volume volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 (0ac41cf6-0455-4418-b67f-3f39ce9d8c35): created successfully Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a40ad2-e37c-4e99-a36f-0bd6de47001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Flow 'volume_create_manager' (4de4fbf8-aec6-4803-a9d3-5f83d95d31b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5142220a-ee6f-4da5-9169-862c1527f724 tempest-ProjectReaderTests-1811113895 None] Created volume successfully. Sep 25 16:22:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-0ac41cf6-0455-4418-b67f-3f39ce9d8c35-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Lock "cinder-0ac41cf6-0455-4418-b67f-3f39ce9d8c35-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Acquiring lock "cinder-quobyte-0ac41cf6-0455-4418-b67f-3f39ce9d8c35" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-0ac41cf6-0455-4418-b67f-3f39ce9d8c35" acquired by "delete_volume" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0e116-19d7-4f17-b3a2-a6f12bdeaf6c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:35 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 Sep 25 16:22:35 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:35 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35" returned: 0 in 0.604s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:35 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35 Sep 25 16:22:35 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:35 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0ac41cf6-0455-4418-b67f-3f39ce9d8c35" returned: 0 in 0.378s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Lock "cinder-quobyte-0ac41cf6-0455-4418-b67f-3f39ce9d8c35" released by "delete_volume" :: held 1.079s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Created reservations ['a80684a6-b0b7-4c70-9769-ff1ba45185b7', 'f9c8f015-cfbf-4a89-9af7-d5ecc39d2d19', '3b0a0ad3-06ba-49c5-bb48-a232cbe7161f', 'ce4c46e9-681b-4971-abb3-afe554d74617'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:36 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:36 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:36 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.423s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Deleted volume successfully. Sep 25 16:22:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ee2a538d-7483-4f01-b9eb-cd68faddaaed tempest-ProjectReaderTests-1811113895 None] Lock "cinder-0ac41cf6-0455-4418-b67f-3f39ce9d8c35-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Flow 'volume_create_manager' (fcc3a005-313d-4d51-94f5-cb7e7437bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04543678-dbea-49ef-b160-120bc061d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04543678-dbea-49ef-b160-120bc061d04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1860877663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbe2f51-502d-4cfc-9b71-3e148c6080a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a41a47d77c148508252fab6eb91e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:43Z,use_quota=True,user_id='80b771e2d36b44c28e277039208bc966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e874d18c-05e2-4242-93c2-61735019d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e874d18c-05e2-4242-93c2-61735019d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c5971b-e5a3-4e3b-874e-71d4cd60627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c5971b-e5a3-4e3b-874e-71d4cd60627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbe2f51-502d-4cfc-9b71-3e148c6080a4', 'volume_name': 'volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf3c896-56fa-4894-8c67-94a0a140b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf3c896-56fa-4894-8c67-94a0a140b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae584d86-0e03-4a84-81bd-98c62e67de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:42 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Volume 9dbe2f51-502d-4cfc-9b71-3e148c6080a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4', 'volume_size': 1} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1860877663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbe2f51-502d-4cfc-9b71-3e148c6080a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a41a47d77c148508252fab6eb91e7d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:43Z,use_quota=True,user_id='80b771e2d36b44c28e277039208bc966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Creating volume 9dbe2f51-502d-4cfc-9b71-3e148c6080a4 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:42 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:42 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 1073741824 Sep 25 16:22:42 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:43 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 1073741824" returned: 0 in 0.857s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:43 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 Sep 25 16:22:43 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:44 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4" returned: 0 in 0.487s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae584d86-0e03-4a84-81bd-98c62e67de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d46e5a-8782-4e6b-851c-96ed04b47d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:44 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Volume volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 (9dbe2f51-502d-4cfc-9b71-3e148c6080a4): created successfully Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d46e5a-8782-4e6b-851c-96ed04b47d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Flow 'volume_create_manager' (fcc3a005-313d-4d51-94f5-cb7e7437bcde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-215cbb44-0cf8-46c0-9376-a5c72b2be689 tempest-VolumesMetadataTest-1636499445 None] Created volume successfully. Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Flow 'volume_create_manager' (dc9bb6a8-1270-47af-be4c-ee022f1db038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a91ebf-e848-4fb2-9ac6-2acd7321fb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a91ebf-e848-4fb2-9ac6-2acd7321fb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1116553938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57888387-54ad-4b31-afec-dbc33b9545a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a14f92e52a43a5a819216de331146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:44Z,use_quota=True,user_id='e50dbdfa1ad9466aae846472d072ba4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b04a28-25fb-44f6-8367-4f7c8a5da67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b04a28-25fb-44f6-8367-4f7c8a5da67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d2b3d0-da01-494d-9be9-d3624ed12c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d2b3d0-da01-494d-9be9-d3624ed12c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57888387-54ad-4b31-afec-dbc33b9545a5', 'volume_name': 'volume-57888387-54ad-4b31-afec-dbc33b9545a5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59742b58-25a7-4d87-9175-6e2d58041c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59742b58-25a7-4d87-9175-6e2d58041c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1de1710-92e2-4388-9e15-54778eabc5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:44 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Volume 57888387-54ad-4b31-afec-dbc33b9545a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57888387-54ad-4b31-afec-dbc33b9545a5', 'volume_size': 1} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1116553938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57888387-54ad-4b31-afec-dbc33b9545a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a14f92e52a43a5a819216de331146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:44Z,use_quota=True,user_id='e50dbdfa1ad9466aae846472d072ba4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Creating volume 57888387-54ad-4b31-afec-dbc33b9545a5 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:44 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:44 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 1073741824 Sep 25 16:22:44 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:45 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 1073741824" returned: 0 in 0.913s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:45 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 Sep 25 16:22:45 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:45 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5" returned: 0 in 0.337s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1de1710-92e2-4388-9e15-54778eabc5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57888387-54ad-4b31-afec-dbc33b9545a5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de48e0dd-03e1-4543-9244-22338169ff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:45 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Volume volume-57888387-54ad-4b31-afec-dbc33b9545a5 (57888387-54ad-4b31-afec-dbc33b9545a5): created successfully Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de48e0dd-03e1-4543-9244-22338169ff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Flow 'volume_create_manager' (dc9bb6a8-1270-47af-be4c-ee022f1db038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ecd7aea8-b016-469d-b934-be5892077059 tempest-VolumesTransfersV357Test-1265996230 None] Created volume successfully. Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Acquiring lock "cinder-9dbe2f51-502d-4cfc-9b71-3e148c6080a4-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Lock "cinder-9dbe2f51-502d-4cfc-9b71-3e148c6080a4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Acquiring lock "cinder-quobyte-9dbe2f51-502d-4cfc-9b71-3e148c6080a4" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Lock "cinder-quobyte-9dbe2f51-502d-4cfc-9b71-3e148c6080a4" acquired by "delete_volume" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5c0a6d-9866-43e6-ba57-77f11d04bf92]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:46 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 Sep 25 16:22:46 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:46 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4" returned: 0 in 0.583s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:46 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4 Sep 25 16:22:46 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:47 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9dbe2f51-502d-4cfc-9b71-3e148c6080a4" returned: 0 in 0.403s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Lock "cinder-quobyte-9dbe2f51-502d-4cfc-9b71-3e148c6080a4" released by "delete_volume" :: held 1.070s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Created reservations ['c7739a48-1c61-4fe5-971b-80e6b5eeef76', '7f033ecb-39eb-4138-9f0d-8674c002feeb', 'def318d6-ef1f-4c10-8bbc-f5249fa20659', 'c3477480-8e35-4dc0-a875-0ac06b987f8b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:47 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:47 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:47 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-36427e27-33d7-4953-82e4-8a9c902badf0 tempest-VolumesTransfersV357Test-1390565875 None] Transfer volume completed successfully. Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.413s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:47 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Deleted volume successfully. Sep 25 16:22:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1101cfd4-0893-4859-b173-61bba8dbf546 tempest-VolumesMetadataTest-1636499445 None] Lock "cinder-9dbe2f51-502d-4cfc-9b71-3e148c6080a4-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Acquiring lock "cinder-57888387-54ad-4b31-afec-dbc33b9545a5-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-57888387-54ad-4b31-afec-dbc33b9545a5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Acquiring lock "cinder-quobyte-57888387-54ad-4b31-afec-dbc33b9545a5" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-quobyte-57888387-54ad-4b31-afec-dbc33b9545a5" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e382e02d-aefa-479f-b58a-7440b36a68c0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:49 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 Sep 25 16:22:49 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:49 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5" returned: 0 in 0.474s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:49 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5 Sep 25 16:22:49 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:50 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-57888387-54ad-4b31-afec-dbc33b9545a5" returned: 0 in 0.347s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-quobyte-57888387-54ad-4b31-afec-dbc33b9545a5" released by "delete_volume" :: held 0.909s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Created reservations ['a69c2324-a167-4969-8505-217e8c16abff', 'cef143e0-6ec3-4563-b070-bfeec8491449', 'beebcf21-ca39-4f9d-8f6a-0cdc478a1385', '30e2d0a4-bcbb-44dd-b888-83541d5f3edd'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:50 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:50 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:50 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.282s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Deleted volume successfully. Sep 25 16:22:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-16cecc62-d06d-4a37-95b6-e19343dd3738 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-57888387-54ad-4b31-afec-dbc33b9545a5-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Flow 'volume_create_manager' (e95c3ab7-5144-4418-b6a9-d8145de7426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4af91a-6b00-4394-80df-5b0d3d3d0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4af91a-6b00-4394-80df-5b0d3d3d0071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-469070971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49aaef69-985f-4565-b75d-6cf19c765476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a14f92e52a43a5a819216de331146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:52Z,use_quota=True,user_id='e50dbdfa1ad9466aae846472d072ba4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbd687d-e937-43b3-b8ec-4b8be4fa819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbd687d-e937-43b3-b8ec-4b8be4fa819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0a7f99-990f-4d0e-b2b3-cffaf7a4c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0a7f99-990f-4d0e-b2b3-cffaf7a4c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49aaef69-985f-4565-b75d-6cf19c765476', 'volume_name': 'volume-49aaef69-985f-4565-b75d-6cf19c765476', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69352077-282a-4d68-8b8b-f0ed0bbd28e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69352077-282a-4d68-8b8b-f0ed0bbd28e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5103c8-5c5a-458c-8efd-c416c50aff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Volume 49aaef69-985f-4565-b75d-6cf19c765476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49aaef69-985f-4565-b75d-6cf19c765476', 'volume_size': 1} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-469070971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49aaef69-985f-4565-b75d-6cf19c765476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a14f92e52a43a5a819216de331146c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:52Z,use_quota=True,user_id='e50dbdfa1ad9466aae846472d072ba4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Creating volume 49aaef69-985f-4565-b75d-6cf19c765476 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:52 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:52 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 1073741824 Sep 25 16:22:52 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:53 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 1073741824" returned: 0 in 1.011s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Flow 'volume_create_manager' (b0067350-d436-44fd-8efa-05290456ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7ee5cc-beca-4761-9e42-c0ded2c397e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7ee5cc-beca-4761-9e42-c0ded2c397e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1437767815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c1b328-295a-4d22-913f-d563702c6026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460e1294fd794542a964307319926bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:53Z,use_quota=True,user_id='72c6cca3791d477099e2cb43b2c470eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e7a424-1c9a-4935-b123-5fb846da5574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e7a424-1c9a-4935-b123-5fb846da5574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a993a-713c-4779-a65e-34437b92b98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a993a-713c-4779-a65e-34437b92b98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c1b328-295a-4d22-913f-d563702c6026', 'volume_name': 'volume-54c1b328-295a-4d22-913f-d563702c6026', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d591be31-8aef-46b9-9781-d5282439af19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d591be31-8aef-46b9-9781-d5282439af19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7e218d-d0c9-49df-90c5-9f34e6ccf7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Volume 54c1b328-295a-4d22-913f-d563702c6026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c1b328-295a-4d22-913f-d563702c6026', 'volume_size': 1} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:53 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 Sep 25 16:22:53 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:54 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476" returned: 0 in 0.436s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1437767815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c1b328-295a-4d22-913f-d563702c6026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460e1294fd794542a964307319926bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:53Z,use_quota=True,user_id='72c6cca3791d477099e2cb43b2c470eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Creating volume 54c1b328-295a-4d22-913f-d563702c6026 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:54 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5103c8-5c5a-458c-8efd-c416c50aff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49aaef69-985f-4565-b75d-6cf19c765476', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab8850c-bd99-4321-a4d9-9134461b8c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:54 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 1073741824 Sep 25 16:22:54 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:54 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Volume volume-49aaef69-985f-4565-b75d-6cf19c765476 (49aaef69-985f-4565-b75d-6cf19c765476): created successfully Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab8850c-bd99-4321-a4d9-9134461b8c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Flow 'volume_create_manager' (e95c3ab7-5144-4418-b6a9-d8145de7426f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Flow 'volume_create_manager' (7aefc8c9-60cc-4ca5-b6fa-179020161127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe69486-4033-4ef5-bc07-5376474e7c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-db8e9fa6-eebc-4334-b712-4fe8b69736c2 tempest-VolumesTransfersV357Test-1265996230 None] Created volume successfully. Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe69486-4033-4ef5-bc07-5376474e7c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1169743189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7106cda-8e7b-4464-9855-608a5191f9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460e1294fd794542a964307319926bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:54Z,use_quota=True,user_id='72c6cca3791d477099e2cb43b2c470eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943fbc91-aca0-494e-b88c-08a40601e1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943fbc91-aca0-494e-b88c-08a40601e1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82452d21-9fac-4168-8f34-5b45b96b82e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82452d21-9fac-4168-8f34-5b45b96b82e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7106cda-8e7b-4464-9855-608a5191f9b3', 'volume_name': 'volume-e7106cda-8e7b-4464-9855-608a5191f9b3', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f271056-0632-4de9-884e-c92e12c3f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f271056-0632-4de9-884e-c92e12c3f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e739674d-85ad-42f4-83ed-ca86fcb34347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:54 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Volume e7106cda-8e7b-4464-9855-608a5191f9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7106cda-8e7b-4464-9855-608a5191f9b3', 'volume_size': 1} Sep 25 16:22:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Acquiring lock "cinder-49aaef69-985f-4565-b75d-6cf19c765476-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-49aaef69-985f-4565-b75d-6cf19c765476-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:55 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 1073741824" returned: 0 in 1.035s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Acquiring lock "cinder-quobyte-49aaef69-985f-4565-b75d-6cf19c765476" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-quobyte-49aaef69-985f-4565-b75d-6cf19c765476" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c234b55-3581-4ef2-9952-b7b3d6d92764]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:55 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 Sep 25 16:22:55 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:55 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 Sep 25 16:22:55 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:55 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026" returned: 0 in 0.477s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1169743189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7106cda-8e7b-4464-9855-608a5191f9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460e1294fd794542a964307319926bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:54Z,use_quota=True,user_id='72c6cca3791d477099e2cb43b2c470eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Creating volume e7106cda-8e7b-4464-9855-608a5191f9b3 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:55 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7e218d-d0c9-49df-90c5-9f34e6ccf7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c1b328-295a-4d22-913f-d563702c6026', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:55 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 1073741824 Sep 25 16:22:55 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89231cfb-650a-45ec-bd8d-541d4f5c1a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:55 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Volume volume-54c1b328-295a-4d22-913f-d563702c6026 (54c1b328-295a-4d22-913f-d563702c6026): created successfully Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89231cfb-650a-45ec-bd8d-541d4f5c1a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Flow 'volume_create_manager' (b0067350-d436-44fd-8efa-05290456ba04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:55 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-108cb466-5d63-4e5d-b96f-e1c605c621aa tempest-TestServerVolumeAttachmentScenario-1621903153 None] Created volume successfully. Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476" returned: 0 in 0.672s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:56 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476 Sep 25 16:22:56 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:56 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49aaef69-985f-4565-b75d-6cf19c765476" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-quobyte-49aaef69-985f-4565-b75d-6cf19c765476" released by "delete_volume" :: held 1.213s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Created reservations ['4b7f15d4-8daa-4ec7-85e2-8ac804982240', '1f78cdd2-7e13-405e-abe5-46a78ce747d2', '3a76cb9f-5278-485c-a0ef-3083f9f95d93', 'b190c1c8-1e8c-48db-b73a-3c3f272a7636'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:22:56 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 1073741824" returned: 0 in 0.833s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:56 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 Sep 25 16:22:56 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:56 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:22:56 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:57 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3" returned: 0 in 0.456s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e739674d-85ad-42f4-83ed-ca86fcb34347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7106cda-8e7b-4464-9855-608a5191f9b3', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bfa5ad-d23b-47e6-87e8-94e9ce234cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Volume volume-e7106cda-8e7b-4464-9855-608a5191f9b3 (e7106cda-8e7b-4464-9855-608a5191f9b3): created successfully Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bfa5ad-d23b-47e6-87e8-94e9ce234cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Flow 'volume_create_manager' (7aefc8c9-60cc-4ca5-b6fa-179020161127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.420s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:22:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Deleted volume successfully. Sep 25 16:22:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6e0157d4-86cd-40e1-b6f3-7da7002d38c5 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Created volume successfully. Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bf10f446-8d75-4b4a-b05b-11a02f4e1727 tempest-VolumesTransfersV357Test-973481396 None] Lock "cinder-49aaef69-985f-4565-b75d-6cf19c765476-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Flow 'volume_create_manager' (8a81af41-c678-4420-b9b1-33833a81fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaff7291-ade1-430a-88ab-a88d0134a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaff7291-ade1-430a-88ab-a88d0134a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-407132823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4260b0-f12c-4b6d-8009-d74967c56350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a153025da8b7408c8ac500a5427b4441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:57Z,use_quota=True,user_id='947e6d2925b34098b621d1cf53d4f88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735f0802-83d7-4de4-895a-f7813b113a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735f0802-83d7-4de4-895a-f7813b113a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3383100d-5c00-4552-a183-26cc500f3af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3383100d-5c00-4552-a183-26cc500f3af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4260b0-f12c-4b6d-8009-d74967c56350', 'volume_name': 'volume-9b4260b0-f12c-4b6d-8009-d74967c56350', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c58cdf-a701-41ef-a76b-74685830430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c58cdf-a701-41ef-a76b-74685830430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd62604-9280-4fe3-aee2-0865f6f56793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Volume 9b4260b0-f12c-4b6d-8009-d74967c56350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4260b0-f12c-4b6d-8009-d74967c56350', 'volume_size': 1} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-407132823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4260b0-f12c-4b6d-8009-d74967c56350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a153025da8b7408c8ac500a5427b4441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:22:57Z,use_quota=True,user_id='947e6d2925b34098b621d1cf53d4f88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Creating volume 9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:22:57 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:22:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:57 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 1073741824 Sep 25 16:22:57 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:58 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 1073741824" returned: 0 in 0.811s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:22:58 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 Sep 25 16:22:58 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:22:59 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Sep 25 16:22:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350" returned: 0 in 0.470s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:22:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:22:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:22:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd62604-9280-4fe3-aee2-0865f6f56793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4260b0-f12c-4b6d-8009-d74967c56350', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0a114d-167c-46a0-ac56-411559e3c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:22:59 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Volume volume-9b4260b0-f12c-4b6d-8009-d74967c56350 (9b4260b0-f12c-4b6d-8009-d74967c56350): created successfully Sep 25 16:22:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0a114d-167c-46a0-ac56-411559e3c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:22:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Flow 'volume_create_manager' (8a81af41-c678-4420-b9b1-33833a81fe73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:22:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-395c0cf4-6316-4fa5-a8d2-0dc90271002a tempest-VolumesCloneTest-1940740648 None] Created volume successfully. Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Flow 'volume_create_manager' (9dcf4b81-9e73-4536-b0fb-14ebf7fc3b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6ffda6-add6-4056-b0f0-dd2181e1d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6ffda6-add6-4056-b0f0-dd2181e1d288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2046686622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e005ee-671d-41e8-80bc-929289bc5474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a153025da8b7408c8ac500a5427b4441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9b4260b0-f12c-4b6d-8009-d74967c56350,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:00Z,use_quota=True,user_id='947e6d2925b34098b621d1cf53d4f88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8465b48-deaf-47d3-ac0e-effeb4bb7d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8465b48-deaf-47d3-ac0e-effeb4bb7d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d016d-3195-4820-a588-6f6029c43ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d016d-3195-4820-a588-6f6029c43ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd3e005ee-671d-41e8-80bc-929289bc5474', 'volume_name': 'volume-d3e005ee-671d-41e8-80bc-929289bc5474', 'volume_size': 2, 'source_volid': '9b4260b0-f12c-4b6d-8009-d74967c56350', 'source_volstatus': 'available'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52870e50-a7f4-4846-a08b-23f64c009ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52870e50-a7f4-4846-a08b-23f64c009ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093182c1-9aec-46e1-8158-c50aa5d14e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:00 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Volume d3e005ee-671d-41e8-80bc-929289bc5474: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d3e005ee-671d-41e8-80bc-929289bc5474', 'volume_size': 2, 'source_volid': '9b4260b0-f12c-4b6d-8009-d74967c56350', 'source_volstatus': 'available'} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:00 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Cloning volume 9b4260b0-f12c-4b6d-8009-d74967c56350 to volume d3e005ee-671d-41e8-80bc-929289bc5474 Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Creating offline snapshot e80381f1-8321-44f7-9fdf-ac2f9b2adf03 of volume 9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80b0d2-25ed-4f21-afab-5b9cb7c72dab]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:00 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 Sep 25 16:23:00 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 1G Sep 25 16:23:01 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:01 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 1G" returned: 0 in 0.715s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4260b0-f12c-4b6d-8009-d74967c56350 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:01 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4260b0-f12c-4b6d-8009-d74967c56350 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 Sep 25 16:23:01 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:02 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4260b0-f12c-4b6d-8009-d74967c56350 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03" returned: 0 in 0.528s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:02 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 is being set with open permissions: ugo+rw Sep 25 16:23:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:02 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 Sep 25 16:23:02 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:02 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03" returned: 0 in 0.476s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:02 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.info Sep 25 16:23:02 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:03 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.info" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:03 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.info is being set with open permissions: ugo+rw Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:03 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.info Sep 25 16:23:03 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:03 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.info" returned: 0 in 0.536s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Acquiring lock "cinder-quobyte-d3e005ee-671d-41e8-80bc-929289bc5474" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-d3e005ee-671d-41e8-80bc-929289bc5474" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] snapshot: e80381f1-8321-44f7-9fdf-ac2f9b2adf03, volume: d3e005ee-671d-41e8-80bc-929289bc5474, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fd073c-6c5b-4336-a972-191dfc5a2982]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:04 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 Sep 25 16:23:04 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:04 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03" returned: 0 in 0.534s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b4260b0-f12c-4b6d-8009-d74967c56350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:23:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4485eed-17ad-48b4-8788-e9735d6c4783]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:04 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 Sep 25 16:23:04 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:05 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350" returned: 0 in 0.580s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:23:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:23:05 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:23:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:05 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 Sep 25 16:23:05 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:12 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=48,cinder:INSERT=22,cinder:UPDATE=80,cinder:DELETE=11 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:12 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=62,cinder:INSERT=17,cinder:UPDATE=85,cinder:DELETE=6 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:23:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:23:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:15 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:23:15 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:16 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.893s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:23:16 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474" returned: 0 in 11.590s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350, size 1024.00 MB, duration 11.59 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:23:16 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Converted 1024.00 MB image at 88.35 MB/s Sep 25 16:23:16 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 is being set with open permissions: ugo+rw Sep 25 16:23:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:16 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 Sep 25 16:23:16 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:17 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474" returned: 0 in 0.449s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-d3e005ee-671d-41e8-80bc-929289bc5474" released by "_copy_volume_from_snapshot" :: held 13.324s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Acquiring lock "cinder-quobyte-e80381f1-8321-44f7-9fdf-ac2f9b2adf03" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-e80381f1-8321-44f7-9fdf-ac2f9b2adf03" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Deleting offline snapshot e80381f1-8321-44f7-9fdf-ac2f9b2adf03 of volume 9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] snapshot_file for this snap is: volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f41253-3764-49f5-9981-5ee8fa90ee83]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:17 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 Sep 25 16:23:17 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:18 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Flow 'volume_create_manager' (08279963-a767-4229-81ba-89cc1b826cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07dd830-abbb-4651-a571-1a035d73e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03" returned: 0 in 0.786s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b4260b0-f12c-4b6d-8009-d74967c56350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07dd830-abbb-4651-a571-1a035d73e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-379665761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a68ccd-3626-40c2-a7c7-94eb3d7eebee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f53102567e40b98b5cb90212db23f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:18Z,use_quota=True,user_id='51cb399b3b0c4bd2a12c52da23e9c6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621fada4-f4e6-407f-b119-b1baa06caed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621fada4-f4e6-407f-b119-b1baa06caed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d314dd-fe9e-486e-bd83-42745977b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d314dd-fe9e-486e-bd83-42745977b518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a68ccd-3626-40c2-a7c7-94eb3d7eebee', 'volume_name': 'volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee', 'volume_size': 2}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc50b9-2e9b-423f-859c-93fa60d6fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc50b9-2e9b-423f-859c-93fa60d6fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d931a2-5872-423f-b0a8-2a3d3e2ed0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:18 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Volume d3a68ccd-3626-40c2-a7c7-94eb3d7eebee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee', 'volume_size': 2} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4c7d22-fb7d-4827-8406-46760828cd73]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:18 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 Sep 25 16:23:18 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:18 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350" returned: 0 in 0.762s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:19 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 Sep 25 16:23:19 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:19 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03" returned: 0 in 0.613s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:19 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03 Sep 25 16:23:19 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:19 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350.e80381f1-8321-44f7-9fdf-ac2f9b2adf03" returned: 0 in 0.358s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-e80381f1-8321-44f7-9fdf-ac2f9b2adf03" released by "_delete_snapshot" :: held 2.854s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.689s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.949s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-379665761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a68ccd-3626-40c2-a7c7-94eb3d7eebee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73f53102567e40b98b5cb90212db23f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:18Z,use_quota=True,user_id='51cb399b3b0c4bd2a12c52da23e9c6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Creating volume d3a68ccd-3626-40c2-a7c7-94eb3d7eebee {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:20 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee 2147483648 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093182c1-9aec-46e1-8158-c50aa5d14e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e005ee-671d-41e8-80bc-929289bc5474', 'volume_size': 2, 'source_volid': '9b4260b0-f12c-4b6d-8009-d74967c56350', 'source_volstatus': 'available'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:20 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee 2147483648 Sep 25 16:23:20 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b89ac7-5e52-424a-9f9b-3ea8f377ca59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Volume volume-d3e005ee-671d-41e8-80bc-929289bc5474 (d3e005ee-671d-41e8-80bc-929289bc5474): created successfully Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b89ac7-5e52-424a-9f9b-3ea8f377ca59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Flow 'volume_create_manager' (9dcf4b81-9e73-4536-b0fb-14ebf7fc3b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-23f14a76-f332-4b41-98b2-9ebe487704a4 tempest-VolumesCloneTest-1940740648 None] Created volume successfully. Sep 25 16:23:21 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee 2147483648" returned: 0 in 0.846s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:21 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee Sep 25 16:23:21 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:21 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee" returned: 0 in 0.456s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d931a2-5872-423f-b0a8-2a3d3e2ed0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee', 'volume_size': 2}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df915831-f52b-4288-a409-046edbe8547c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Volume volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee (d3a68ccd-3626-40c2-a7c7-94eb3d7eebee): created successfully Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df915831-f52b-4288-a409-046edbe8547c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Flow 'volume_create_manager' (08279963-a767-4229-81ba-89cc1b826cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8299520e-8099-4a9d-b888-1a5d999cf79f tempest-VolumesCloneNegativeTest-1505331948 None] Created volume successfully. Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Acquiring lock "cinder-d3e005ee-671d-41e8-80bc-929289bc5474-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Lock "cinder-d3e005ee-671d-41e8-80bc-929289bc5474-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Acquiring lock "cinder-quobyte-d3e005ee-671d-41e8-80bc-929289bc5474" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-d3e005ee-671d-41e8-80bc-929289bc5474" acquired by "delete_volume" :: waited 0.046s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b45c3-7d1d-4768-9777-704972f4b9ad]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:22 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 Sep 25 16:23:22 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:22 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474" returned: 0 in 0.668s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Acquiring lock "cinder-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:22 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474 Sep 25 16:23:22 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Lock "cinder-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Acquiring lock "cinder-quobyte-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Lock "cinder-quobyte-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee" acquired by "delete_volume" :: waited 0.042s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5c45ec-8f7c-4382-9e3c-574a857288f1]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:23 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee Sep 25 16:23:23 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:23 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3e005ee-671d-41e8-80bc-929289bc5474" returned: 0 in 0.744s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-d3e005ee-671d-41e8-80bc-929289bc5474" released by "delete_volume" :: held 1.505s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Created reservations ['91bc8ba0-3659-4c2d-855d-2fea7a4fbcd9', 'ade732ed-9bcb-4e92-97dd-63062e768e59', 'abd93ef2-8fdd-4775-9876-2c10e03d5d12', '3e2cce65-db99-4d8b-9c49-8cda91c5efa3'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:23 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee" returned: 0 in 0.806s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:23 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:23:23 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:23 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee Sep 25 16:23:23 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:24 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee" returned: 0 in 0.739s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:24 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.811s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Lock "cinder-quobyte-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee" released by "delete_volume" :: held 1.658s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Acquiring lock "cinder-9b4260b0-f12c-4b6d-8009-d74967c56350-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Deleted volume successfully. Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-9b4260b0-f12c-4b6d-8009-d74967c56350-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-aeea9dd6-0cb8-4a65-ba10-4e51431847ff tempest-VolumesCloneTest-1940740648 None] Lock "cinder-d3e005ee-671d-41e8-80bc-929289bc5474-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Created reservations ['6b2b2da3-2a0a-43a6-9e8d-42a0604ee8a9', '618a1ec9-00c3-4b6d-8ce4-f8e10d479613', 'd2ff08ce-b3c4-48b8-86cf-5bf700938d2d', '25717717-87a5-4254-841b-e5ed94254e0e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Acquiring lock "cinder-quobyte-9b4260b0-f12c-4b6d-8009-d74967c56350" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-9b4260b0-f12c-4b6d-8009-d74967c56350" acquired by "delete_volume" :: waited 0.045s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8de106-6968-4fcd-aba2-95a3335b9f92]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:25 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 Sep 25 16:23:25 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:25 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:23:25 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:25 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.499s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Deleted volume successfully. Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-098368d7-3a4c-46c2-beed-cc77f2617a44 tempest-VolumesCloneNegativeTest-1505331948 None] Lock "cinder-d3a68ccd-3626-40c2-a7c7-94eb3d7eebee-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:25 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350" returned: 0 in 0.839s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:25 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350 Sep 25 16:23:25 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:26 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9b4260b0-f12c-4b6d-8009-d74967c56350" returned: 0 in 0.694s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-quobyte-9b4260b0-f12c-4b6d-8009-d74967c56350" released by "delete_volume" :: held 1.674s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Created reservations ['30991ff0-b940-4206-9724-f695411f12e3', 'e678214d-7a8e-4923-a364-45efd3bcef2c', 'dd74ec14-537d-4561-a462-e29d4b9c790f', '01fd05db-305a-47ea-bb9c-d06944683eec'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:27 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:23:27 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:27 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.633s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:27 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:27 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Deleted volume successfully. Sep 25 16:23:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e605af68-5b72-4bfe-a84e-a2f4c70dcf71 tempest-VolumesCloneTest-1940740648 None] Lock "cinder-9b4260b0-f12c-4b6d-8009-d74967c56350-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Flow 'volume_create_manager' (7804cd73-a4d9-4c8d-b4e4-db7face85dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeda8e3-0784-460b-9653-e0f763058d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeda8e3-0784-460b-9653-e0f763058d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1109844743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ef67c6-6aab-49e1-81c8-c9a679f8b847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70890588841648e18beb3d205a4c6caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:35Z,use_quota=True,user_id='cf6add5e0abb42a9a3572154224c7279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae29a564-5f1e-4821-a7dd-a70cb1bd7639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae29a564-5f1e-4821-a7dd-a70cb1bd7639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93f3a0c-7fcd-412d-bcce-841ac33e16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93f3a0c-7fcd-412d-bcce-841ac33e16c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ef67c6-6aab-49e1-81c8-c9a679f8b847', 'volume_name': 'volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4892cd-8278-4c4d-a9a0-2bdc06e78edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4892cd-8278-4c4d-a9a0-2bdc06e78edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee3e0c8-508e-4324-90d8-84699d0e81ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:34 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Volume 78ef67c6-6aab-49e1-81c8-c9a679f8b847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847', 'volume_size': 1} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1109844743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ef67c6-6aab-49e1-81c8-c9a679f8b847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70890588841648e18beb3d205a4c6caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:35Z,use_quota=True,user_id='cf6add5e0abb42a9a3572154224c7279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Creating volume 78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:34 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:23:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:34 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 1073741824 Sep 25 16:23:34 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:35 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Flow 'volume_create_manager' (e20984c8-a8ef-415c-b96d-302892b3d8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045030a1-7e5a-4042-9fbb-999933b16c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 1073741824" returned: 0 in 0.799s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045030a1-7e5a-4042-9fbb-999933b16c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-775779381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b5defa-30fe-47a6-98f5-91f93e61fe0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ab33b82a404d74921a24e11af2f320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:35Z,use_quota=True,user_id='fd1c33139e064a07992fba0d998db2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499f95f5-9292-4079-b0ae-f458c6f822f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499f95f5-9292-4079-b0ae-f458c6f822f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263cb94f-d337-4330-a7ea-125e9ef0be4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263cb94f-d337-4330-a7ea-125e9ef0be4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b5defa-30fe-47a6-98f5-91f93e61fe0a', 'volume_name': 'volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c526cc-0c92-44ca-b358-3a6a34e1a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c526cc-0c92-44ca-b358-3a6a34e1a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cc1df9-456d-4062-a37f-dccd9b5b1706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Volume 53b5defa-30fe-47a6-98f5-91f93e61fe0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a', 'volume_size': 1} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:35 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 Sep 25 16:23:35 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:35 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (9b23a288-c466-45d6-b516-8235de9c2470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e3a099-6a09-47c7-abe0-0dcbda214a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847" returned: 0 in 0.290s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-775779381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b5defa-30fe-47a6-98f5-91f93e61fe0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ab33b82a404d74921a24e11af2f320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:35Z,use_quota=True,user_id='fd1c33139e064a07992fba0d998db2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Creating volume 53b5defa-30fe-47a6-98f5-91f93e61fe0a {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:35 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e3a099-6a09-47c7-abe0-0dcbda214a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1300686305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a595263f-df87-471d-a82e-27773df7ec34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:36Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521e8b22-ad00-4778-9b1d-48b2b293c65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a 1073741824 Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521e8b22-ad00-4778-9b1d-48b2b293c65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:35 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d2a994-d6c3-4c35-9a33-8f0f8a029539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d2a994-d6c3-4c35-9a33-8f0f8a029539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a595263f-df87-471d-a82e-27773df7ec34', 'volume_name': 'volume-a595263f-df87-471d-a82e-27773df7ec34', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744a6911-6b76-4a02-8bef-37fb972e0c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744a6911-6b76-4a02-8bef-37fb972e0c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9348fb52-8cc2-4c05-8a01-4d1370a63e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:36 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Volume a595263f-df87-471d-a82e-27773df7ec34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a595263f-df87-471d-a82e-27773df7ec34', 'volume_size': 1} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee3e0c8-508e-4324-90d8-84699d0e81ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede88f3a-a210-4e35-887b-1d2d42ddcf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:36 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Volume volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 (78ef67c6-6aab-49e1-81c8-c9a679f8b847): created successfully Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede88f3a-a210-4e35-887b-1d2d42ddcf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Flow 'volume_create_manager' (7804cd73-a4d9-4c8d-b4e4-db7face85dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-462360fa-ac4f-4045-986a-a729b5930956 tempest-SnapshotDependencyTests-461608449 None] Created volume successfully. Sep 25 16:23:36 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a 1073741824" returned: 0 in 0.525s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:36 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a Sep 25 16:23:36 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:36 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a" returned: 0 in 0.310s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1300686305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a595263f-df87-471d-a82e-27773df7ec34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:36Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Creating volume a595263f-df87-471d-a82e-27773df7ec34 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:36 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cc1df9-456d-4062-a37f-dccd9b5b1706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 1073741824 Sep 25 16:23:36 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc7ecd0-2088-4e03-96e8-993daf25cb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:36 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Volume volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a (53b5defa-30fe-47a6-98f5-91f93e61fe0a): created successfully Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc7ecd0-2088-4e03-96e8-993daf25cb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Flow 'volume_create_manager' (e20984c8-a8ef-415c-b96d-302892b3d8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7da418b1-7ccd-4785-b708-253a0a43034d tempest-VolumesNegativeTest-352027404 None] Created volume successfully. Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:37 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 1073741824" returned: 0 in 0.640s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:37 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 Sep 25 16:23:37 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:37 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34" returned: 0 in 0.304s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.787s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9348fb52-8cc2-4c05-8a01-4d1370a63e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a595263f-df87-471d-a82e-27773df7ec34', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8c7bca-e457-44c6-a943-5b88ca7778c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Creating offline snapshot 3934fc56-ce73-44b3-a847-7664cfc31b31 of volume 78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:23:37 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Volume volume-a595263f-df87-471d-a82e-27773df7ec34 (a595263f-df87-471d-a82e-27773df7ec34): created successfully Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8c7bca-e457-44c6-a943-5b88ca7778c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (9b23a288-c466-45d6-b516-8235de9c2470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d099e3af-0532-4c91-a0e3-86e6c8af903f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-22d00b5a-be38-47b3-84c6-8e31b73094ef tempest-VolumesGetTest-1682549982 None] Created volume successfully. Sep 25 16:23:38 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 Sep 25 16:23:38 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:38 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847" returned: 0 in 0.584s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:38 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 1G Sep 25 16:23:38 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:39 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 1G" returned: 0 in 0.716s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:39 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 Sep 25 16:23:39 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (2897c76f-f043-4e1d-bc0f-1108dc61f468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d5f717-1c45-4354-b227-096d2e036bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d5f717-1c45-4354-b227-096d2e036bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1183641182',display_name='tempest-VolumesGetTest-Volume-1234378728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30f8274-80e0-4a5a-bc1f-102247c1ade9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:39Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a404415-5828-47fc-b492-05cad8e52a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a404415-5828-47fc-b492-05cad8e52a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7ece9b-fa3f-4b6e-aaa8-cd8c00d9a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7ece9b-fa3f-4b6e-aaa8-cd8c00d9a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30f8274-80e0-4a5a-bc1f-102247c1ade9', 'volume_name': 'volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a55da3f-723b-4b8a-86c4-35056df383c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a55da3f-723b-4b8a-86c4-35056df383c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba059b9-5c55-44fe-a92b-c24cded0624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:39 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Volume a30f8274-80e0-4a5a-bc1f-102247c1ade9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9', 'volume_size': 1} Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:39 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31" returned: 0 in 0.450s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:39 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 is being set with open permissions: ugo+rw Sep 25 16:23:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:39 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 Sep 25 16:23:39 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:40 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31" returned: 0 in 0.438s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:40 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.info Sep 25 16:23:40 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:40 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.info" returned: 0 in 0.475s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:40 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.info is being set with open permissions: ugo+rw Sep 25 16:23:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:40 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.info Sep 25 16:23:40 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:41 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.info" returned: 0 in 0.575s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.491s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1183641182',display_name='tempest-VolumesGetTest-Volume-1234378728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30f8274-80e0-4a5a-bc1f-102247c1ade9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:39Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Creating volume a30f8274-80e0-4a5a-bc1f-102247c1ade9 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:41 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:41 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 1073741824 Sep 25 16:23:41 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b5e397e7-8395-470a-a0be-bed27f1546e0 tempest-SnapshotDependencyTests-461608449 None] Create snapshot completed successfully Sep 25 16:23:41 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 1073741824" returned: 0 in 0.563s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:42 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 Sep 25 16:23:42 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:42 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9" returned: 0 in 0.400s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba059b9-5c55-44fe-a92b-c24cded0624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46c393b-dec5-47a9-aabe-685d7438d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:42 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Volume volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 (a30f8274-80e0-4a5a-bc1f-102247c1ade9): created successfully Sep 25 16:23:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46c393b-dec5-47a9-aabe-685d7438d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (2897c76f-f043-4e1d-bc0f-1108dc61f468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-efed3db0-ecf4-4181-86f3-6abc3a17df32 tempest-VolumesGetTest-1682549982 None] Created volume successfully. Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Flow 'volume_create_manager' (d48a2379-76f7-4274-9dbe-29f93bc6cd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e554fc8-353e-4d87-ab66-64f05a0b46eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e554fc8-353e-4d87-ab66-64f05a0b46eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00044d8-3621-44bf-b3bd-9788c1b04e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70890588841648e18beb3d205a4c6caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3934fc56-ce73-44b3-a847-7664cfc31b31,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:43Z,use_quota=True,user_id='cf6add5e0abb42a9a3572154224c7279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0919db2-5d2b-4749-ab23-b09abbc4f884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0919db2-5d2b-4749-ab23-b09abbc4f884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83133f3-45e1-46eb-bf97-cd6a4aaf7e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83133f3-45e1-46eb-bf97-cd6a4aaf7e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a00044d8-3621-44bf-b3bd-9788c1b04e6e', 'volume_name': 'volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e', 'volume_size': 1, 'snapshot_id': '3934fc56-ce73-44b3-a847-7664cfc31b31'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff92c4f-069c-4be0-a1a1-32beb19db441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff92c4f-069c-4be0-a1a1-32beb19db441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc4628b-82ec-4aeb-bd1a-6104436015cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Volume a00044d8-3621-44bf-b3bd-9788c1b04e6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e', 'volume_size': 1, 'snapshot_id': '3934fc56-ce73-44b3-a847-7664cfc31b31'} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-quobyte-3934fc56-ce73-44b3-a847-7664cfc31b31-a00044d8-3621-44bf-b3bd-9788c1b04e6e" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-3934fc56-ce73-44b3-a847-7664cfc31b31-a00044d8-3621-44bf-b3bd-9788c1b04e6e" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Creating volume a00044d8-3621-44bf-b3bd-9788c1b04e6e from snapshot 3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-quobyte-a00044d8-3621-44bf-b3bd-9788c1b04e6e" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-a00044d8-3621-44bf-b3bd-9788c1b04e6e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] snapshot: 3934fc56-ce73-44b3-a847-7664cfc31b31, volume: a00044d8-3621-44bf-b3bd-9788c1b04e6e, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e464d4a-9a76-4cd5-92e3-078d19a29ca6]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:43 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 Sep 25 16:23:43 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-a30f8274-80e0-4a5a-bc1f-102247c1ade9-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Lock "cinder-a30f8274-80e0-4a5a-bc1f-102247c1ade9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-a30f8274-80e0-4a5a-bc1f-102247c1ade9" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-a30f8274-80e0-4a5a-bc1f-102247c1ade9" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[59924707-d3a9-4aa7-bcfd-f935e00ed6a2]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 Sep 25 16:23:44 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31" returned: 0 in 0.766s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f8762-051d-467b-b8f7-664408a156de]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 Sep 25 16:23:44 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:44 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9" returned: 0 in 0.680s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:44 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9 Sep 25 16:23:44 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:45 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847" returned: 0 in 0.793s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:45 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e Sep 25 16:23:45 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a30f8274-80e0-4a5a-bc1f-102247c1ade9" returned: 0 in 0.590s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:45 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-a30f8274-80e0-4a5a-bc1f-102247c1ade9" released by "delete_volume" :: held 1.373s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Created reservations ['485da82f-37ec-4ba8-a6b1-a320aed43332', 'fdb3c251-f0fc-4b94-b8f4-89a72d955ce7', '060aa23b-b968-45dc-831f-479a0fd09e53', '9c01ec25-f6ab-4055-9458-a538713b21b8'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:45 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:23:45 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a23c0af9-6d8d-460a-9f25-ee836921fb60 req-598a4e71-a425-41f1-bba5-6540ea16d0b4 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:46 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.559s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Deleted volume successfully. Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9ae8d605-723a-4fc5-905d-eeec6650253e tempest-VolumesGetTest-1682549982 None] Lock "cinder-a30f8274-80e0-4a5a-bc1f-102247c1ade9-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-a595263f-df87-471d-a82e-27773df7ec34-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Lock "cinder-a595263f-df87-471d-a82e-27773df7ec34-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-a595263f-df87-471d-a82e-27773df7ec34" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-a595263f-df87-471d-a82e-27773df7ec34" acquired by "delete_volume" :: waited 0.053s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8388e2-c283-4f02-a83f-e5afa007cff5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:47 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 Sep 25 16:23:47 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:47 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34" returned: 0 in 0.805s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:47 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34 Sep 25 16:23:47 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:48 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a595263f-df87-471d-a82e-27773df7ec34" returned: 0 in 0.669s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-a595263f-df87-471d-a82e-27773df7ec34" released by "delete_volume" :: held 1.604s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Created reservations ['c71852bd-48d5-4b83-a4a6-788572c1d1dc', '0d89914b-4848-45f4-80a3-70ae8f89ea8f', '443ccab8-1fcb-496a-b864-9aafc67aa1b6', '344f2a74-6d7e-4fcc-bb9e-709092c5437d'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:48 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:23:48 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:49 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.883s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:49 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:23:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Deleted volume successfully. Sep 25 16:23:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e72f8c68-8b48-452a-a768-c69acd42597f tempest-VolumesGetTest-1682549982 None] Lock "cinder-a595263f-df87-471d-a82e-27773df7ec34-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:51 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:23:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (c833afe2-3ccc-4298-99f9-0ccd5d34f24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e628de-6e0a-45f4-9148-4111a9b04452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e628de-6e0a-45f4-9148-4111a9b04452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-114954805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be4c592-eac5-4358-a259-8b7bcaa82f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:51Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eba758-091b-4455-b136-9b45144449bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eba758-091b-4455-b136-9b45144449bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f3f161-04dd-4cd1-af0f-6da4c40f5b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f3f161-04dd-4cd1-af0f-6da4c40f5b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be4c592-eac5-4358-a259-8b7bcaa82f86', 'volume_name': 'volume-9be4c592-eac5-4358-a259-8b7bcaa82f86', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60256a64-eeec-4031-89c8-d88929f7451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60256a64-eeec-4031-89c8-d88929f7451f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0705e2-d509-4d1e-930a-669f89f8f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Volume 9be4c592-eac5-4358-a259-8b7bcaa82f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be4c592-eac5-4358-a259-8b7bcaa82f86', 'volume_size': 1} Sep 25 16:23:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:57 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e" returned: 0 in 12.647s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:57 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847, size 1024.00 MB, duration 12.65 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:23:57 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Converted 1024.00 MB image at 80.96 MB/s Sep 25 16:23:57 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e is being set with open permissions: ugo+rw Sep 25 16:23:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:57 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e Sep 25 16:23:57 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:58 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e" returned: 0 in 0.306s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-a00044d8-3621-44bf-b3bd-9788c1b04e6e" released by "_copy_volume_from_snapshot" :: held 14.676s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-3934fc56-ce73-44b3-a847-7664cfc31b31-a00044d8-3621-44bf-b3bd-9788c1b04e6e" released by "_create_volume_from_snapshot" :: held 14.758s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.780s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a23c0af9-6d8d-460a-9f25-ee836921fb60 req-598a4e71-a425-41f1-bba5-6540ea16d0b4 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.314s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a23c0af9-6d8d-460a-9f25-ee836921fb60 req-598a4e71-a425-41f1-bba5-6540ea16d0b4 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.155s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-114954805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be4c592-eac5-4358-a259-8b7bcaa82f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:23:51Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Creating volume 9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:23:58 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc4628b-82ec-4aeb-bd1a-6104436015cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e', 'volume_size': 1, 'snapshot_id': '3934fc56-ce73-44b3-a847-7664cfc31b31'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:58 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 1073741824 Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae446cde-415d-41d5-a5b2-15ab138915c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:58 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Volume volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e (a00044d8-3621-44bf-b3bd-9788c1b04e6e): created successfully Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae446cde-415d-41d5-a5b2-15ab138915c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Flow 'volume_create_manager' (d48a2379-76f7-4274-9dbe-29f93bc6cd7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a23c0af9-6d8d-460a-9f25-ee836921fb60 req-598a4e71-a425-41f1-bba5-6540ea16d0b4 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-54c1b328-295a-4d22-913f-d563702c6026', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3af684e1-e190-4cf4-885a-cc142d5aedba', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:23:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8c210428-20d4-439b-85c5-1d66924ab17c tempest-SnapshotDependencyTests-461608449 None] Created volume successfully. Sep 25 16:23:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-a23c0af9-6d8d-460a-9f25-ee836921fb60 req-598a4e71-a425-41f1-bba5-6540ea16d0b4 tempest-TestServerVolumeAttachmentScenario-1621903153 None] attachment_update completed successfully. Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-3934fc56-ce73-44b3-a847-7664cfc31b31-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-3934fc56-ce73-44b3-a847-7664cfc31b31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-quobyte-78ef67c6-6aab-49e1-81c8-c9a679f8b847" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-78ef67c6-6aab-49e1-81c8-c9a679f8b847" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-quobyte-3934fc56-ce73-44b3-a847-7664cfc31b31" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-3934fc56-ce73-44b3-a847-7664cfc31b31" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:23:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Deleting offline snapshot 3934fc56-ce73-44b3-a847-7664cfc31b31 of volume 78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:23:59 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] snapshot_file for this snap is: volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 1073741824" returned: 0 in 0.788s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[280fa3e9-5186-44bb-ba10-e4903404aee7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:59 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 Sep 25 16:23:59 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:59 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 Sep 25 16:23:59 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:23:59 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86" returned: 0 in 0.494s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0705e2-d509-4d1e-930a-669f89f8f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be4c592-eac5-4358-a259-8b7bcaa82f86', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb81ce73-b15f-4d09-a1af-9395bddbf5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:23:59 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Volume volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 (9be4c592-eac5-4358-a259-8b7bcaa82f86): created successfully Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb81ce73-b15f-4d09-a1af-9395bddbf5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (c833afe2-3ccc-4298-99f9-0ccd5d34f24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:23:59 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31" returned: 0 in 0.666s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:23:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-efa93c05-5346-4630-bbc3-6b8fdedab3c2 tempest-VolumesGetTest-1682549982 None] Created volume successfully. Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd50204-7be6-40c7-8b94-933d6eb05b88]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:23:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:23:59 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 Sep 25 16:23:59 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:00 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847" returned: 0 in 0.667s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:00 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 Sep 25 16:24:00 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:00 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31" returned: 0 in 0.542s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:01 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31 Sep 25 16:24:01 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (22121b92-4827-4583-85a4-e85d03b74d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb983635-e23a-4959-89d4-d995e16a74fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb983635-e23a-4959-89d4-d995e16a74fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1192157840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2d7204-39a2-4986-88ce-9701070412a8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9be4c592-eac5-4358-a259-8b7bcaa82f86,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:01Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a568c077-f913-4161-8a9d-4acefc0cf058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a568c077-f913-4161-8a9d-4acefc0cf058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8d9dce-3dbb-43ae-aa5a-d8292a6f9972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8d9dce-3dbb-43ae-aa5a-d8292a6f9972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2d2d7204-39a2-4986-88ce-9701070412a8', 'volume_name': 'volume-2d2d7204-39a2-4986-88ce-9701070412a8', 'volume_size': 1, 'source_volid': '9be4c592-eac5-4358-a259-8b7bcaa82f86', 'source_volstatus': 'available'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32345d76-cf7c-4e5a-986a-5f1fe8bec8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32345d76-cf7c-4e5a-986a-5f1fe8bec8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a74d8b-4230-47d3-b390-0df854499965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:01 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Volume 2d2d7204-39a2-4986-88ce-9701070412a8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2d2d7204-39a2-4986-88ce-9701070412a8', 'volume_size': 1, 'source_volid': '9be4c592-eac5-4358-a259-8b7bcaa82f86', 'source_volstatus': 'available'} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:01 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Cloning volume 9be4c592-eac5-4358-a259-8b7bcaa82f86 to volume 2d2d7204-39a2-4986-88ce-9701070412a8 Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Creating offline snapshot 09ba4748-aff7-466e-a802-7e9de74f8eed of volume 9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[953ce3aa-516e-485d-b6af-7b6f6c3da966]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:01 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 Sep 25 16:24:01 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:01 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847.3934fc56-ce73-44b3-a847-7664cfc31b31" returned: 0 in 0.488s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-3934fc56-ce73-44b3-a847-7664cfc31b31" released by "_delete_snapshot" :: held 2.554s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-78ef67c6-6aab-49e1-81c8-c9a679f8b847" released by "delete_snapshot" :: held 2.590s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Created reservations ['35a58ecb-4c2a-4236-b1d0-aa64b74c907d', 'e8fec0d3-22a9-4c17-8ab8-7f2a1c8cfb1c', '02fbdf69-3574-4fe4-a025-8f5b1f40aee1', '342061ac-0c99-4507-878f-5293842a2279'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Delete snapshot completed successfully. Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-188cd9e9-da74-498f-9654-2820fa083d02 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-3934fc56-ce73-44b3-a847-7664cfc31b31-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:01 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86" returned: 0 in 0.600s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:01 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed 1G Sep 25 16:24:01 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-78ef67c6-6aab-49e1-81c8-c9a679f8b847-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-78ef67c6-6aab-49e1-81c8-c9a679f8b847-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-quobyte-78ef67c6-6aab-49e1-81c8-c9a679f8b847" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-78ef67c6-6aab-49e1-81c8-c9a679f8b847" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd693dfb-ba63-48a6-b793-562120d01dfb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:02 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 Sep 25 16:24:02 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:02 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed 1G" returned: 0 in 0.697s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:02 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed Sep 25 16:24:02 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:02 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847" returned: 0 in 0.501s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:02 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847 Sep 25 16:24:02 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:03 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed" returned: 0 in 0.438s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:03 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed is being set with open permissions: ugo+rw Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:03 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed Sep 25 16:24:03 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:03 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-78ef67c6-6aab-49e1-81c8-c9a679f8b847" returned: 0 in 0.517s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-78ef67c6-6aab-49e1-81c8-c9a679f8b847" released by "delete_volume" :: held 1.108s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:03 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed" returned: 0 in 0.449s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Created reservations ['1f9e9749-a961-453f-9d2e-e6aa15bd8924', '855aae36-eb98-411e-9c8c-64e6649dfa73', 'cc35a56a-465e-4265-a682-5839a0189e42', '7772d17d-40fa-4a5e-8200-091313a1920c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:03 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.info Sep 25 16:24:03 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:03 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:03 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:03 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.info" returned: 0 in 0.389s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:03 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.info is being set with open permissions: ugo+rw Sep 25 16:24:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:03 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.info Sep 25 16:24:03 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.343s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Deleted volume successfully. Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-49f44b23-835b-468a-8dbe-f68199f79f90 tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-78ef67c6-6aab-49e1-81c8-c9a679f8b847-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:04 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.info" returned: 0 in 0.397s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-2d2d7204-39a2-4986-88ce-9701070412a8" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-2d2d7204-39a2-4986-88ce-9701070412a8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] snapshot: 09ba4748-aff7-466e-a802-7e9de74f8eed, volume: 2d2d7204-39a2-4986-88ce-9701070412a8, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f903ea07-c0aa-489f-b78b-b828081354f9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-a00044d8-3621-44bf-b3bd-9788c1b04e6e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-a00044d8-3621-44bf-b3bd-9788c1b04e6e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:04 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed Sep 25 16:24:04 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "cinder-quobyte-a00044d8-3621-44bf-b3bd-9788c1b04e6e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-a00044d8-3621-44bf-b3bd-9788c1b04e6e" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5a8bf-cd04-4724-8ded-48ec9a0c5642]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:04 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e Sep 25 16:24:04 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a8630c4a-b3d3-486b-87ee-67e6fc80722b req-bb0c116f-a87a-4015-b781-e7adfbdbd095 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:04 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed" returned: 0 in 0.486s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be4c592-eac5-4358-a259-8b7bcaa82f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46a097-4070-4781-ba92-26c235f2694c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:05 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 Sep 25 16:24:05 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:05 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e" returned: 0 in 0.539s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:05 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e Sep 25 16:24:05 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:05 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86" returned: 0 in 0.471s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:05 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 Sep 25 16:24:05 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:05 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a00044d8-3621-44bf-b3bd-9788c1b04e6e" returned: 0 in 0.337s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-quobyte-a00044d8-3621-44bf-b3bd-9788c1b04e6e" released by "delete_volume" :: held 0.948s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Created reservations ['9bc5de27-35d4-44e4-9920-8764e363dd03', 'ba671d27-da3f-44fb-9711-5073f0b2b815', 'fce4f826-11fb-4151-846e-a0af193d0067', '19b63f07-6a49-44e3-9f78-b0745c9a5df2'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:05 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:05 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:06 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.409s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:06 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Deleted volume successfully. Sep 25 16:24:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-34d20bd1-4c35-40ef-89de-dacbdc6cc0ad tempest-SnapshotDependencyTests-461608449 None] Lock "cinder-a00044d8-3621-44bf-b3bd-9788c1b04e6e-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Acquiring lock "cinder-53b5defa-30fe-47a6-98f5-91f93e61fe0a-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Lock "cinder-53b5defa-30fe-47a6-98f5-91f93e61fe0a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Acquiring lock "cinder-quobyte-53b5defa-30fe-47a6-98f5-91f93e61fe0a" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Lock "cinder-quobyte-53b5defa-30fe-47a6-98f5-91f93e61fe0a" acquired by "delete_volume" :: waited 0.047s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:11 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cdbb41-39d0-4f3b-a698-03800685e9c7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:11 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a Sep 25 16:24:11 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:12 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a" returned: 0 in 1.077s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:12 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a Sep 25 16:24:12 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:12 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-53b5defa-30fe-47a6-98f5-91f93e61fe0a" returned: 0 in 0.767s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Lock "cinder-quobyte-53b5defa-30fe-47a6-98f5-91f93e61fe0a" released by "delete_volume" :: held 2.013s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:12 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=99,cinder:SELECT=79,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=83,cinder:SELECT=70,cinder:DELETE=12,cinder:INSERT=21 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Created reservations ['a7f4441c-f923-4ff1-be91-14e2c48ac152', 'c190d7e9-1add-4c1a-9088-040b96a64611', '5b701ebb-e36a-4a6e-aa9d-df346c4564f1', '641b5240-0d2b-4af1-b1cc-8e6cc4926159'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:13 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:13 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:14 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.662s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:14 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:14 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Deleted volume successfully. Sep 25 16:24:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b3fc4185-0864-40c6-a498-e10b61c52e7b tempest-VolumesNegativeTest-352027404 None] Lock "cinder-53b5defa-30fe-47a6-98f5-91f93e61fe0a-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:15 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8" returned: 0 in 9.607s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86, size 1024.00 MB, duration 9.61 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:24:15 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Converted 1024.00 MB image at 106.58 MB/s Sep 25 16:24:15 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 is being set with open permissions: ugo+rw Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:15 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 Sep 25 16:24:15 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:15 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8" returned: 0 in 0.361s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-2d2d7204-39a2-4986-88ce-9701070412a8" released by "_copy_volume_from_snapshot" :: held 11.047s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-09ba4748-aff7-466e-a802-7e9de74f8eed" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:15 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:15 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-09ba4748-aff7-466e-a802-7e9de74f8eed" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Deleting offline snapshot 09ba4748-aff7-466e-a802-7e9de74f8eed of volume 9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] snapshot_file for this snap is: volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df25f99f-5533-4528-8914-081d336e3bc8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:15 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed Sep 25 16:24:15 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:15 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.299s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:24:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:24:16 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed" returned: 0 in 0.520s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be4c592-eac5-4358-a259-8b7bcaa82f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:24:16 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[710566c5-fa4e-4e82-9adc-e2e64b1660f9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:16 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 Sep 25 16:24:16 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:16 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86" returned: 0 in 0.794s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:16 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed Sep 25 16:24:16 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:17 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed" returned: 0 in 0.510s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:17 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed Sep 25 16:24:17 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:17 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86.09ba4748-aff7-466e-a802-7e9de74f8eed" returned: 0 in 0.394s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-09ba4748-aff7-466e-a802-7e9de74f8eed" released by "_delete_snapshot" :: held 2.360s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.722s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a8630c4a-b3d3-486b-87ee-67e6fc80722b req-bb0c116f-a87a-4015-b781-e7adfbdbd095 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.035s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [req-a8630c4a-b3d3-486b-87ee-67e6fc80722b req-bb0c116f-a87a-4015-b781-e7adfbdbd095 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a74d8b-4230-47d3-b390-0df854499965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2d7204-39a2-4986-88ce-9701070412a8', 'volume_size': 1, 'source_volid': '9be4c592-eac5-4358-a259-8b7bcaa82f86', 'source_volstatus': 'available'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fb0363-6813-441d-98df-12f426d2051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:18 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Volume volume-2d2d7204-39a2-4986-88ce-9701070412a8 (2d2d7204-39a2-4986-88ce-9701070412a8): created successfully Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fb0363-6813-441d-98df-12f426d2051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (22121b92-4827-4583-85a4-e85d03b74d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-a8630c4a-b3d3-486b-87ee-67e6fc80722b req-bb0c116f-a87a-4015-b781-e7adfbdbd095 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051', 'name': 'volume-e7106cda-8e7b-4464-9855-608a5191f9b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16a86852-07a2-4e87-a98a-4b7fe384d3f8', 'enforce_multipath': True} {{(pid=87467) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 16:24:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-87195f26-4f36-4968-8b94-1e95eb8bf42d tempest-VolumesGetTest-1682549982 None] Created volume successfully. Sep 25 16:24:18 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-a8630c4a-b3d3-486b-87ee-67e6fc80722b req-bb0c116f-a87a-4015-b781-e7adfbdbd095 tempest-TestServerVolumeAttachmentScenario-1621903153 None] attachment_update completed successfully. Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (32f15dfa-7562-4714-9ef9-4917b05b808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19274acd-0a0e-49a9-94fe-a08be4898f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19274acd-0a0e-49a9-94fe-a08be4898f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035724222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d23919-ba4c-46d9-9e77-2a4646ad043f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:19Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e733a324-c4d9-4547-8f0b-ca26a2c14131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e733a324-c4d9-4547-8f0b-ca26a2c14131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff1eba6-74a2-4350-89a0-0881e465eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff1eba6-74a2-4350-89a0-0881e465eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d23919-ba4c-46d9-9e77-2a4646ad043f', 'volume_name': 'volume-49d23919-ba4c-46d9-9e77-2a4646ad043f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69feb4f0-b881-4fdb-830c-5c204f8dbbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69feb4f0-b881-4fdb-830c-5c204f8dbbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e1d3c6-8df9-4c91-b820-83ef2fe79a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:19 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Volume 49d23919-ba4c-46d9-9e77-2a4646ad043f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d23919-ba4c-46d9-9e77-2a4646ad043f', 'volume_size': 1} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035724222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d23919-ba4c-46d9-9e77-2a4646ad043f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:19Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Creating volume 49d23919-ba4c-46d9-9e77-2a4646ad043f {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:19 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:19 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f 1073741824 Sep 25 16:24:19 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (5d7fbdc5-dcc0-4e33-b5e4-fcd6d40194c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1554b4a6-2bcc-4817-8f0e-d627dbf8ff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1554b4a6-2bcc-4817-8f0e-d627dbf8ff27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2133975287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32409719-5d3b-451a-bc4b-d0bce1fc8060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:20Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abefd59-c64a-431a-9e34-973545a167f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abefd59-c64a-431a-9e34-973545a167f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfca2ea-a435-4cae-8ea3-7076f09049f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfca2ea-a435-4cae-8ea3-7076f09049f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32409719-5d3b-451a-bc4b-d0bce1fc8060', 'volume_name': 'volume-32409719-5d3b-451a-bc4b-d0bce1fc8060', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556213f4-5c04-4ecb-921c-bd21f440a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556213f4-5c04-4ecb-921c-bd21f440a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8919c9d9-b011-4d6f-9b82-3671f631b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Volume 32409719-5d3b-451a-bc4b-d0bce1fc8060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32409719-5d3b-451a-bc4b-d0bce1fc8060', 'volume_size': 1} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:20 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f 1073741824" returned: 0 in 0.987s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:20 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f Sep 25 16:24:20 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (875da299-0824-47be-a53b-04a355e00f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:20 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c564f4b8-de49-4e4c-830c-028e92218c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2133975287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32409719-5d3b-451a-bc4b-d0bce1fc8060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:20Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Creating volume 32409719-5d3b-451a-bc4b-d0bce1fc8060 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:20 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c564f4b8-de49-4e4c-830c-028e92218c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-627655675',display_name='tempest-VolumesGetTest-Volume-565734850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd170a3e-9f3b-4353-bca7-55b1d9058c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:20Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de534215-c183-4d3d-8c78-8b2cbe8e19cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 1073741824 Sep 25 16:24:20 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de534215-c183-4d3d-8c78-8b2cbe8e19cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f70bf9-673c-42e1-bf17-c0e6f89c60d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f70bf9-673c-42e1-bf17-c0e6f89c60d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd170a3e-9f3b-4353-bca7-55b1d9058c9e', 'volume_name': 'volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b5d6c7-6b59-4ad9-94e0-25e0ea159e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b5d6c7-6b59-4ad9-94e0-25e0ea159e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce56fdae-9bd1-4658-b413-5baf6846cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Volume bd170a3e-9f3b-4353-bca7-55b1d9058c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e', 'volume_size': 1} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e1d3c6-8df9-4c91-b820-83ef2fe79a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d23919-ba4c-46d9-9e77-2a4646ad043f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c61a698-962f-4fdc-84ec-9c88720bcfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (da736cc3-121d-459f-953b-0c549f520925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfd767c-eed0-4cac-bc42-31772646cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfd767c-eed0-4cac-bc42-31772646cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059688762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3ed9c4-02c2-42ac-b83b-2dde068a32a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:21Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c413cf-1391-4059-9aff-5101abebfd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c413cf-1391-4059-9aff-5101abebfd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9eefd1c-18e3-4f00-823b-04b6f489b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9eefd1c-18e3-4f00-823b-04b6f489b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3ed9c4-02c2-42ac-b83b-2dde068a32a5', 'volume_name': 'volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c14164e-4a49-46ec-946f-8aaf6c3a4977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c14164e-4a49-46ec-946f-8aaf6c3a4977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2b2eb7-3211-4078-92f9-790419c6d435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Volume 6b3ed9c4-02c2-42ac-b83b-2dde068a32a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5', 'volume_size': 1} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Volume volume-49d23919-ba4c-46d9-9e77-2a4646ad043f (49d23919-ba4c-46d9-9e77-2a4646ad043f): created successfully Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c61a698-962f-4fdc-84ec-9c88720bcfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (32f15dfa-7562-4714-9ef9-4917b05b808c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-684fa8a6-510f-48b6-b033-246aaf0823b2 tempest-CreateVolumesFromImageTest-1540929754 None] Created volume successfully. Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (7a602f79-ea91-442f-b470-617c717b9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06849622-8c08-4fbe-87ad-b4787a37acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06849622-8c08-4fbe-87ad-b4787a37acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1252138446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203f01cc-9b73-4005-94a3-8ab37a48e281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:21Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7202959c-be75-40b9-b057-a7843de34517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7202959c-be75-40b9-b057-a7843de34517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bf7f12-7e7c-4bc6-8623-2a6ea06b08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bf7f12-7e7c-4bc6-8623-2a6ea06b08bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203f01cc-9b73-4005-94a3-8ab37a48e281', 'volume_name': 'volume-203f01cc-9b73-4005-94a3-8ab37a48e281', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcce3921-42b1-4092-81f3-55e0d8e9879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcce3921-42b1-4092-81f3-55e0d8e9879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ce401d-a3aa-45d5-810d-5396367ec7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Volume 203f01cc-9b73-4005-94a3-8ab37a48e281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203f01cc-9b73-4005-94a3-8ab37a48e281', 'volume_size': 1} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-0e0f4002-c686-4ead-89c6-e20aa27f9690 req-02980b1a-9bb4-424a-bca7-52abd44c98f7 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Terminate volume connection completed successfully. Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-0e0f4002-c686-4ead-89c6-e20aa27f9690 req-02980b1a-9bb4-424a-bca7-52abd44c98f7 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Deleting attachment 16a86852-07a2-4e87-a98a-4b7fe384d3f8. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:24:21 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 1073741824" returned: 0 in 1.019s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:21 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 Sep 25 16:24:21 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (1dd16f8a-0531-485d-b1a9-8f5721177c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fad607-f46c-4cdc-912b-2ab3949d7186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fad607-f46c-4cdc-912b-2ab3949d7186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223143168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e03d8c-0130-44ed-aca2-e827c9016f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:22Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd428c1-6b48-47fc-8799-d31b437b2974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd428c1-6b48-47fc-8799-d31b437b2974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43065d9-bd2f-4668-849a-87af9ae311db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43065d9-bd2f-4668-849a-87af9ae311db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e03d8c-0130-44ed-aca2-e827c9016f06', 'volume_name': 'volume-81e03d8c-0130-44ed-aca2-e827c9016f06', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cb4f41-2e61-437f-b5e3-95c48c7bd5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cb4f41-2e61-437f-b5e3-95c48c7bd5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37012fa-7da3-4c1e-8b9f-4f2c4c7269f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:22 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Volume 81e03d8c-0130-44ed-aca2-e827c9016f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e03d8c-0130-44ed-aca2-e827c9016f06', 'volume_size': 1} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:22 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060" returned: 0 in 0.466s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-627655675',display_name='tempest-VolumesGetTest-Volume-565734850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd170a3e-9f3b-4353-bca7-55b1d9058c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:20Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Creating volume bd170a3e-9f3b-4353-bca7-55b1d9058c9e {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:22 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8919c9d9-b011-4d6f-9b82-3671f631b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32409719-5d3b-451a-bc4b-d0bce1fc8060', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:22 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e 1073741824 Sep 25 16:24:22 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fec6f71-ccc8-48dd-8d98-8ce5173b4e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:22 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Volume volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 (32409719-5d3b-451a-bc4b-d0bce1fc8060): created successfully Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fec6f71-ccc8-48dd-8d98-8ce5173b4e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (5d7fbdc5-dcc0-4e33-b5e4-fcd6d40194c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:22 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f0b27328-4c55-4f3a-87c3-cc2d30d2af6e tempest-CreateVolumesFromImageTest-1540929754 None] Created volume successfully. Sep 25 16:24:22 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e 1073741824" returned: 0 in 0.598s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:22 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e Sep 25 16:24:22 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [req-49370357-0680-4b27-878e-9808be6b520e req-d99ee9ae-6585-4bc9-ba64-ada3fd84be26 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Terminate volume connection completed successfully. Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [req-49370357-0680-4b27-878e-9808be6b520e req-d99ee9ae-6585-4bc9-ba64-ada3fd84be26 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Deleting attachment 3af684e1-e190-4cf4-885a-cc142d5aedba. {{(pid=87467) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 16:24:23 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e" returned: 0 in 0.321s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059688762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3ed9c4-02c2-42ac-b83b-2dde068a32a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:21Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Creating volume 6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:23 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce56fdae-9bd1-4658-b413-5baf6846cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:23 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 1073741824 Sep 25 16:24:23 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbebf45e-d650-4f0e-9e5d-d5dc42024d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:23 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Volume volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e (bd170a3e-9f3b-4353-bca7-55b1d9058c9e): created successfully Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbebf45e-d650-4f0e-9e5d-d5dc42024d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (875da299-0824-47be-a53b-04a355e00f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-686ec568-9aff-4a57-a55e-a6828af0f8af tempest-VolumesGetTest-1682549982 None] Created volume successfully. Sep 25 16:24:23 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 1073741824" returned: 0 in 0.550s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:23 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 Sep 25 16:24:23 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:24 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5" returned: 0 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.791s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1252138446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203f01cc-9b73-4005-94a3-8ab37a48e281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:21Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Creating volume 203f01cc-9b73-4005-94a3-8ab37a48e281 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:24 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2b2eb7-3211-4078-92f9-790419c6d435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:24 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 1073741824 Sep 25 16:24:24 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed25017-5f1b-4d23-a14f-6ebeea7bc55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:24 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Volume volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 (6b3ed9c4-02c2-42ac-b83b-2dde068a32a5): created successfully Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed25017-5f1b-4d23-a14f-6ebeea7bc55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (da736cc3-121d-459f-953b-0c549f520925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e4d74124-2a15-48da-9b93-8aed87c50efa tempest-CreateVolumesFromImageTest-1540929754 None] Created volume successfully. Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-bd170a3e-9f3b-4353-bca7-55b1d9058c9e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Lock "cinder-bd170a3e-9f3b-4353-bca7-55b1d9058c9e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-bd170a3e-9f3b-4353-bca7-55b1d9058c9e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-bd170a3e-9f3b-4353-bca7-55b1d9058c9e" acquired by "delete_volume" :: waited 0.049s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d421153f-9ad9-42ce-8971-62b255d75f95]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:24 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e Sep 25 16:24:24 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:25 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 1073741824" returned: 0 in 1.096s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:25 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 Sep 25 16:24:25 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:25 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e" returned: 0 in 0.564s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:25 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e Sep 25 16:24:25 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:25 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281" returned: 0 in 0.449s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.758s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223143168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e03d8c-0130-44ed-aca2-e827c9016f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90885f5ce3de405896fcf07acfc25581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:22Z,use_quota=True,user_id='a904000d47384bea8455c576b31fa95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Creating volume 81e03d8c-0130-44ed-aca2-e827c9016f06 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:25 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ce401d-a3aa-45d5-810d-5396367ec7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203f01cc-9b73-4005-94a3-8ab37a48e281', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64693f6f-b537-4f4d-8553-04e2c9172a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:25 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 1073741824 Sep 25 16:24:25 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:25 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Volume volume-203f01cc-9b73-4005-94a3-8ab37a48e281 (203f01cc-9b73-4005-94a3-8ab37a48e281): created successfully Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64693f6f-b537-4f4d-8553-04e2c9172a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (7a602f79-ea91-442f-b470-617c717b9638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bd170a3e-9f3b-4353-bca7-55b1d9058c9e" returned: 0 in 0.506s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-73367a12-26cc-4593-97c3-25b5de1f6eb1 tempest-CreateVolumesFromImageTest-1540929754 None] Created volume successfully. Sep 25 16:24:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-bd170a3e-9f3b-4353-bca7-55b1d9058c9e" released by "delete_volume" :: held 1.194s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Created reservations ['9743e05c-098a-4d4a-aab2-900ea79a1795', '8e449da2-3d2d-4063-a09e-f219d74cabb2', '34bfbc61-a9ec-4855-a8aa-eb4a79c6f858', '786321df-47ed-4e94-8100-da78b564d27d'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:26 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:26 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:26 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 1073741824" returned: 0 in 0.816s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:26 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:26 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.526s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:26 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Deleted volume successfully. Sep 25 16:24:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-88bbed37-c357-43e7-b7a1-4084babab59b tempest-VolumesGetTest-1682549982 None] Lock "cinder-bd170a3e-9f3b-4353-bca7-55b1d9058c9e-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:27 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06" returned: 0 in 0.362s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37012fa-7da3-4c1e-8b9f-4f2c4c7269f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e03d8c-0130-44ed-aca2-e827c9016f06', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039a1bf-a10b-414e-80c6-0cf320bb79c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Volume volume-81e03d8c-0130-44ed-aca2-e827c9016f06 (81e03d8c-0130-44ed-aca2-e827c9016f06): created successfully Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039a1bf-a10b-414e-80c6-0cf320bb79c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Flow 'volume_create_manager' (1dd16f8a-0531-485d-b1a9-8f5721177c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:27 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fd910526-521a-4598-acbc-c8546b51ca88 tempest-CreateVolumesFromImageTest-1540929754 None] Created volume successfully. Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-2d2d7204-39a2-4986-88ce-9701070412a8-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Lock "cinder-2d2d7204-39a2-4986-88ce-9701070412a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-2d2d7204-39a2-4986-88ce-9701070412a8" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-2d2d7204-39a2-4986-88ce-9701070412a8" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4613259-f17c-4cd9-8b2b-1a6c246c8cca]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:27 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 Sep 25 16:24:27 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-81e03d8c-0130-44ed-aca2-e827c9016f06-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-81e03d8c-0130-44ed-aca2-e827c9016f06-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-quobyte-81e03d8c-0130-44ed-aca2-e827c9016f06" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-81e03d8c-0130-44ed-aca2-e827c9016f06" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff1603-ed60-425c-a6e3-4c2bb3498b82]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:28 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8" returned: 0 in 0.718s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:28 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8 Sep 25 16:24:28 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:28 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 Sep 25 16:24:28 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:28 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-2d2d7204-39a2-4986-88ce-9701070412a8" returned: 0 in 0.528s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-2d2d7204-39a2-4986-88ce-9701070412a8" released by "delete_volume" :: held 1.362s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:28 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06" returned: 0 in 0.744s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:28 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06 Sep 25 16:24:28 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Created reservations ['a400e505-67c9-4814-9af4-1fe46c255b8a', '3f646540-e9d6-4f43-afa9-b8ab74eaa72e', 'c1b601ef-08bb-496f-83c5-bcdf8ec72391', 'e034efe6-5c1e-4dd8-8d10-902d0da1fb9c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:28 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:28 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:29 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-81e03d8c-0130-44ed-aca2-e827c9016f06" returned: 0 in 0.390s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-81e03d8c-0130-44ed-aca2-e827c9016f06" released by "delete_volume" :: held 1.230s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Created reservations ['eebe0110-4efe-452c-a850-ec456131d1e1', '6ce7cbd2-f5f7-41bb-91f7-a596605d47b9', '38255847-1583-4ab8-8795-b757039c90bd', '35aedca2-d7c1-49ba-b776-b79d9d24f722'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:29 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.351s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Deleted volume successfully. Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-64f232a7-9b6c-4a11-85f0-f4f033d71f7c tempest-VolumesGetTest-1682549982 None] Lock "cinder-2d2d7204-39a2-4986-88ce-9701070412a8-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:29 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:29 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:29 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.287s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Deleted volume successfully. Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-9be4c592-eac5-4358-a259-8b7bcaa82f86-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b9b0b5a4-4f93-4779-9e66-002ca90e76b8 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-81e03d8c-0130-44ed-aca2-e827c9016f06-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Lock "cinder-9be4c592-eac5-4358-a259-8b7bcaa82f86-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-9be4c592-eac5-4358-a259-8b7bcaa82f86" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-9be4c592-eac5-4358-a259-8b7bcaa82f86" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0fb90f-2919-4c05-a188-eb2ca40aed4a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:29 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 Sep 25 16:24:30 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-203f01cc-9b73-4005-94a3-8ab37a48e281-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-203f01cc-9b73-4005-94a3-8ab37a48e281-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-quobyte-203f01cc-9b73-4005-94a3-8ab37a48e281" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-203f01cc-9b73-4005-94a3-8ab37a48e281" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd08e444-db9d-4615-978d-cf03045dd4ec]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:30 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86" returned: 0 in 0.530s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:30 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86 Sep 25 16:24:30 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:30 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 Sep 25 16:24:30 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:30 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9be4c592-eac5-4358-a259-8b7bcaa82f86" returned: 0 in 0.276s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-9be4c592-eac5-4358-a259-8b7bcaa82f86" released by "delete_volume" :: held 0.892s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Created reservations ['8443916a-0124-4ec9-ba5e-5a330a2cfbff', '965e87c4-e7cf-4f4e-b2bf-39a51d192caf', '70004fd2-02d8-4c7e-a941-78340d3415fc', 'cef95276-033f-4d34-b930-ee3abee6c3d3'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:30 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:30 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:30 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281" returned: 0 in 0.627s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:30 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281 Sep 25 16:24:30 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:31 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.342s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Deleted volume successfully. Sep 25 16:24:31 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-203f01cc-9b73-4005-94a3-8ab37a48e281" returned: 0 in 0.316s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-203f01cc-9b73-4005-94a3-8ab37a48e281" released by "delete_volume" :: held 1.026s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-971b25f5-ea5a-4634-8716-8144e9a56367 tempest-VolumesGetTest-1682549982 None] Lock "cinder-9be4c592-eac5-4358-a259-8b7bcaa82f86-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "cinder-e7106cda-8e7b-4464-9855-608a5191f9b3-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-e7106cda-8e7b-4464-9855-608a5191f9b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "cinder-quobyte-e7106cda-8e7b-4464-9855-608a5191f9b3" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Created reservations ['629b61dd-a8c7-4bcf-967c-7c0893c5d0f4', 'a75826c2-05a8-48f7-ae67-6a7d6a101ec6', 'd9f73189-c6b1-460e-82f1-974bb33315d4', '565fc508-1176-411b-ba80-097bf3e63b95'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-quobyte-e7106cda-8e7b-4464-9855-608a5191f9b3" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4eeaa8-7365-4798-b108-bb15cfb66a4d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:31 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:31 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:31 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 Sep 25 16:24:31 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:31 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.291s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Deleted volume successfully. Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1bed36cc-3425-4b61-80cc-36117a0f36fe tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-203f01cc-9b73-4005-94a3-8ab37a48e281-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:31 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (929c87b6-2279-46a0-a970-9a027c281547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c255882c-1bd1-45c9-9031-c2ca0d18cbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3" returned: 0 in 0.514s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:32 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3 Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c255882c-1bd1-45c9-9031-c2ca0d18cbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-487400051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:32Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:32 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f120119-03c5-4d87-a2e6-5a571db29e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f120119-03c5-4d87-a2e6-5a571db29e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acc390c-35b9-4872-9ead-8bcb06f16c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:24:32 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e7106cda-8e7b-4464-9855-608a5191f9b3" returned: 0 in 0.346s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-quobyte-e7106cda-8e7b-4464-9855-608a5191f9b3" released by "delete_volume" :: held 0.920s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Created reservations ['2037e7d3-a6b8-4148-b71d-4bd0cefa5661', '3285318c-c167-4d34-b48e-1d6facbefe99', 'ba43ca2c-7d10-49b0-b498-39fa628e2eeb', '3e82d0b0-8212-4c3a-b57c-bf37aafe20a5'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:32 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:32 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "cinder-54c1b328-295a-4d22-913f-d563702c6026-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-54c1b328-295a-4d22-913f-d563702c6026-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-quobyte-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa503a4-ad3e-45bf-9a8b-da8d58390a14]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acc390c-35b9-4872-9ead-8bcb06f16c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec', 'volume_name': 'volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae6af08-718f-4634-b85c-8404d07b39b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae6af08-718f-4634-b85c-8404d07b39b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affc2c60-9417-4c60-9fc2-7c06bb3ff08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:32 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Volume fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Trying to clone fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "cinder-quobyte-54c1b328-295a-4d22-913f-d563702c6026" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-quobyte-54c1b328-295a-4d22-913f-d563702c6026" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5887dd-a046-4625-a435-82edf16cf07e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:32 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.428s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:32 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:32 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Deleted volume successfully. Sep 25 16:24:33 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 Sep 25 16:24:33 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-292cf7fb-a4e0-492a-ba62-b62264223673 tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-e7106cda-8e7b-4464-9855-608a5191f9b3-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:33 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 Sep 25 16:24:33 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:24:33 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Image download 20.69 MB at 20.69 MB/s Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[40962d2f-f00a-4102-8c07-1a007b211882]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:33 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5" returned: 0 in 0.628s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:33 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026" returned: 0 in 0.535s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:33 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5 Sep 25 16:24:33 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:33 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD Sep 25 16:24:33 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:33 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026 Sep 25 16:24:33 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:33 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5" returned: 0 in 0.277s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5" released by "delete_volume" :: held 0.994s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:33 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-54c1b328-295a-4d22-913f-d563702c6026" returned: 0 in 0.304s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-quobyte-54c1b328-295a-4d22-913f-d563702c6026" released by "delete_volume" :: held 0.909s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:33 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 is fetched for user c9ed47a3bb2e4983a882dd4a5c1cd724. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Created reservations ['aa6184b7-3441-43e1-a85e-f38b963c9e7f', '755f04d1-31f1-4d5b-a78f-1db9602f03ce', 'ef0b6bae-bbe2-4abd-b043-faa65790bbf7', 'a14815e8-4797-4e6f-94e1-0b552a68ae49'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Created reservations ['20b9d6b6-6216-4dad-8e0e-48e050666324', 'cbec0048-6220-4675-b82d-3afb248a20bf', '219f6fda-5877-42d4-935a-db2229440d00', '63bdeb8d-0974-4d66-a63c-8625cbb28989'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd527a63-0c65-41f1-b646-f2452cdd5cde]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:34 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:34 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:34 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:34 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:34 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD Sep 25 16:24:34 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:34 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.308s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Deleted volume successfully. Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae2ae61a-5351-4bbb-8771-61e3a09a1885 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-6b3ed9c4-02c2-42ac-b83b-2dde068a32a5-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:34 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.285s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Deleted volume successfully. Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4aa0e50f-52fc-4c99-89a2-b917dfcf0b4c tempest-TestServerVolumeAttachmentScenario-1621903153 None] Lock "cinder-54c1b328-295a-4d22-913f-d563702c6026-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:34 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-487400051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:32Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Creating volume fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:34 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:34 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec 1073741824 Sep 25 16:24:34 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-32409719-5d3b-451a-bc4b-d0bce1fc8060-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-32409719-5d3b-451a-bc4b-d0bce1fc8060-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-quobyte-32409719-5d3b-451a-bc4b-d0bce1fc8060" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-32409719-5d3b-451a-bc4b-d0bce1fc8060" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:35 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec 1073741824" returned: 0 in 0.587s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eefd07f-8ee4-4fcd-b777-d112eb3e908a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:35 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec Sep 25 16:24:35 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:35 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 Sep 25 16:24:35 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:35 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec" returned: 0 in 0.298s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Attempting download of fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca6d806-2bf2-4a16-82c9-c79c6fadc16f]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_xtjkv2k2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:35 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060" returned: 0 in 0.471s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:35 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060 Sep 25 16:24:35 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:35 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_xtjkv2k2 Sep 25 16:24:35 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:35 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-32409719-5d3b-451a-bc4b-d0bce1fc8060" returned: 0 in 0.271s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-32409719-5d3b-451a-bc4b-d0bce1fc8060" released by "delete_volume" :: held 0.800s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Created reservations ['f1eb7395-de21-4522-aa3a-48a1923e0888', '3c8c2458-c255-4326-b395-9ce063b474e4', 'abb62d92-1b44-46db-8e27-35d72cf907a6', '931744d9-6455-4189-80f8-87c168aeace9'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:35 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_xtjkv2k2" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_xtjkv2k2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:36 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:36 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-49d23919-ba4c-46d9-9e77-2a4646ad043f-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:36 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_xtjkv2k2 Sep 25 16:24:36 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-49d23919-ba4c-46d9-9e77-2a4646ad043f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "cinder-quobyte-49d23919-ba4c-46d9-9e77-2a4646ad043f" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-49d23919-ba4c-46d9-9e77-2a4646ad043f" acquired by "delete_volume" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70970a5-d5ac-4e31-93d7-d90426fd1e2e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:36 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.513s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Deleted volume successfully. Sep 25 16:24:36 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f Sep 25 16:24:36 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8c78532d-4975-4139-be2b-7ddf478d33d1 tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-32409719-5d3b-451a-bc4b-d0bce1fc8060-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:36 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_xtjkv2k2" returned: 1 in 0.665s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_xtjkv2k2' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca2e7e-cf51-4830-b8ee-92ed73e72e7a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:36 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD Sep 25 16:24:36 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:36 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f" returned: 0 in 0.560s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:36 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f Sep 25 16:24:36 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:37 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Copying image from '%(src)s' to volume '%(dest)s' - size: %(size)s {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/image/image_utils.py:1010}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec iflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:37 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec iflag=direct Sep 25 16:24:37 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:37 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-49d23919-ba4c-46d9-9e77-2a4646ad043f" returned: 0 in 0.268s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-quobyte-49d23919-ba4c-46d9-9e77-2a4646ad043f" released by "delete_volume" :: held 0.940s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Created reservations ['77687905-db0e-4a28-a6dc-cf144ad0e0df', 'ff1954d4-3196-430e-888f-4296481de53f', 'c765e575-91ff-4988-9ce0-2609ead3019a', '939c9a33-68f8-413f-a918-c7584f82b7c4'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:37 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec iflag=direct" returned: 0 in 0.439s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:37 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec oflag=direct Sep 25 16:24:37 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:37 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:37 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:37 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec oflag=direct" returned: 0 in 0.271s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec count=22020096 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:37 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec count=22020096 bs=1M iflag=count_bytes,direct oflag=direct Sep 25 16:24:37 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:37 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.256s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Deleted volume successfully. Sep 25 16:24:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a8358355-bd8f-4ec0-bd28-ffcca454c5bd tempest-CreateVolumesFromImageTest-1540929754 None] Lock "cinder-49d23919-ba4c-46d9-9e77-2a4646ad043f-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:38 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD of=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec count=22020096 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 0.858s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:38 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Volume copy details: src /opt/stack/data/cinder/conversion/image_fetch_fc8de055-3e4f-442a-93a1-3bcaad2a5b92_6qkgnb_vdevstack@QuobyteHD, dest /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec, size 21.00 MB, duration 1.00 sec {{(pid=87467) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:509}} Sep 25 16:24:38 devstack cinder-volume[87467]: INFO cinder.volume.volume_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Volume copy 21.00 MB at 21.00 MB/s Sep 25 16:24:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:38 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec 1G Sep 25 16:24:38 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:39 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec 1G" returned: 0 in 0.428s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Downloaded image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}])) to volume fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Temporary image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 for user c9ed47a3bb2e4983a882dd4a5c1cd724 is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Marking volume fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Copying metadata from image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 to fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Creating volume glance metadata for volume fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec backed by image fc8de055-3e4f-442a-93a1-3bcaad2a5b92 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affc2c60-9417-4c60-9fc2-7c06bb3ff08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec', 'volume_size': 1, 'image_id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c09a326e34e4c5f95bfdbe6f8d48da2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fc8de055-3e4f-442a-93a1-3bcaad2a5b92', 'created_at': datetime.datetime(2026, 9, 25, 13, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc8de055-3e4f-442a-93a1-3bcaad2a5b92/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed3dacb-44fd-4dff-a80c-17dbf50f5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:39 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Volume volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec (fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec): created successfully Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed3dacb-44fd-4dff-a80c-17dbf50f5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (929c87b6-2279-46a0-a970-9a027c281547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-536cbd0a-477a-4844-afd8-0e70b1fc2408 tempest-VolumesGetTest-1682549982 None] Created volume successfully. Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (29c6022b-0243-4c09-b92e-d1ceccef6f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84931e28-f7c2-4db5-ab7d-9d309dfbe95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84931e28-f7c2-4db5-ab7d-9d309dfbe95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119878702',display_name='tempest-VolumesGetTest-Volume-1511495768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae55af93-1ce8-4ab7-89e4-45e1c157a0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:41Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dbe032-677b-489c-be06-4bde7b5aba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dbe032-677b-489c-be06-4bde7b5aba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64401b1-9c28-4d34-9908-12ba55456d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64401b1-9c28-4d34-9908-12ba55456d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae55af93-1ce8-4ab7-89e4-45e1c157a0cb', 'volume_name': 'volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca03fd5e-60ab-4bc0-adac-0fc33893451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca03fd5e-60ab-4bc0-adac-0fc33893451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929b53da-3aea-4064-bac5-53ffbffd5736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:40 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Volume ae55af93-1ce8-4ab7-89e4-45e1c157a0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb', 'volume_size': 1} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119878702',display_name='tempest-VolumesGetTest-Volume-1511495768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae55af93-1ce8-4ab7-89e4-45e1c157a0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af35c9507324644a7ea1530a57e2721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:41Z,use_quota=True,user_id='c9ed47a3bb2e4983a882dd4a5c1cd724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Creating volume ae55af93-1ce8-4ab7-89e4-45e1c157a0cb {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:40 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:40 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb 1073741824 Sep 25 16:24:40 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:41 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb 1073741824" returned: 0 in 0.655s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:41 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb Sep 25 16:24:41 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:41 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb" returned: 0 in 0.350s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929b53da-3aea-4064-bac5-53ffbffd5736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8207eec2-e4b7-40dd-8f68-57433c5b6bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:41 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Volume volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb (ae55af93-1ce8-4ab7-89e4-45e1c157a0cb): created successfully Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8207eec2-e4b7-40dd-8f68-57433c5b6bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:41 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Flow 'volume_create_manager' (29c6022b-0243-4c09-b92e-d1ceccef6f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-adc1a672-9987-45ea-b4bd-1670cd4002b4 tempest-VolumesGetTest-1682549982 None] Created volume successfully. Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Flow 'volume_create_manager' (9fa13028-3ab0-4e23-823d-327588b873b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603834ce-179e-4e46-bb5d-4583ddfdb0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603834ce-179e-4e46-bb5d-4583ddfdb0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1063557636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cf90d8-3230-423a-89b1-8bbcb6befa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f468514ccda44df29109aca263c1f17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:43Z,use_quota=True,user_id='413d0458815f446f9c072b3aad304b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6217c96-42b3-447d-bba5-99e383984251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6217c96-42b3-447d-bba5-99e383984251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344addc7-0e62-4a6e-b69e-306c33975dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344addc7-0e62-4a6e-b69e-306c33975dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89cf90d8-3230-423a-89b1-8bbcb6befa64', 'volume_name': 'volume-89cf90d8-3230-423a-89b1-8bbcb6befa64', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7c27a5-f0b0-495c-b0cc-b6cd0c9f8240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7c27a5-f0b0-495c-b0cc-b6cd0c9f8240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0e8f66-13b0-42c2-a55f-21aa18a8480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:42 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Volume 89cf90d8-3230-423a-89b1-8bbcb6befa64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89cf90d8-3230-423a-89b1-8bbcb6befa64', 'volume_size': 1} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1063557636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cf90d8-3230-423a-89b1-8bbcb6befa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f468514ccda44df29109aca263c1f17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:43Z,use_quota=True,user_id='413d0458815f446f9c072b3aad304b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Creating volume 89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:42 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:42 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 1073741824 Sep 25 16:24:42 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Lock "cinder-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c418a4-1105-40f1-a4b2-5a6a8d0e75d3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:43 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 1073741824" returned: 0 in 0.643s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:43 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb Sep 25 16:24:43 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:43 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 Sep 25 16:24:43 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:43 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb" returned: 0 in 0.485s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:43 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64" returned: 0 in 0.314s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:43 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb Sep 25 16:24:43 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0e8f66-13b0-42c2-a55f-21aa18a8480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89cf90d8-3230-423a-89b1-8bbcb6befa64', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c7aa4b-a765-4df4-ad55-b5bc53eb80d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Volume volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 (89cf90d8-3230-423a-89b1-8bbcb6befa64): created successfully Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c7aa4b-a765-4df4-ad55-b5bc53eb80d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Flow 'volume_create_manager' (9fa13028-3ab0-4e23-823d-327588b873b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:43 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3df9d743-8990-47b2-bfaa-d2c3c083e418 tempest-VolumeDependencyTests-1790962001 None] Created volume successfully. Sep 25 16:24:43 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb" returned: 0 in 0.306s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb" released by "delete_volume" :: held 0.867s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Created reservations ['b40e381a-69d7-44bc-9a83-9179f893f8c0', '18481ecc-20b3-46d0-8333-755c57d94de3', 'bf439efd-7eee-4352-afc0-3ecd079107b0', 'e725e615-3857-4ff6-8873-eec6877750e0'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:44 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:44 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Lock "cinder-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Acquiring lock "cinder-quobyte-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[05084b29-0bdb-4cc1-b185-a2c51b3c79c0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:44 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.438s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Deleted volume successfully. Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6ef18771-4377-4a7e-8451-d60988a01b1a tempest-VolumesGetTest-1682549982 None] Lock "cinder-ae55af93-1ce8-4ab7-89e4-45e1c157a0cb-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:44 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec Sep 25 16:24:44 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Creating offline snapshot a2e0a45b-f618-4c7b-a8e5-677170e56339 of volume 89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f355e-f547-4a25-9ea1-84e1047ba4cf]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:44 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec" returned: 0 in 0.441s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:45 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec Sep 25 16:24:45 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:45 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 Sep 25 16:24:45 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:45 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec" returned: 0 in 0.268s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Lock "cinder-quobyte-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec" released by "delete_volume" :: held 0.782s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Created reservations ['bc9647a2-cdf6-46e8-9c69-bcd5e5bd732e', 'ff938b11-94e6-4ccc-ab54-9360ff36ca12', 'f2ea5830-b3ee-459b-adb4-9463624a5a83', 'a77744c5-7d71-4dd1-8e69-6517fb488e1b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:45 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64" returned: 0 in 0.491s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:45 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:24:45 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:45 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 1G Sep 25 16:24:45 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:45 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.430s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:24:45 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Deleted volume successfully. Sep 25 16:24:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3d9423f9-bed9-46cd-b91f-291f79b6b717 tempest-VolumesGetTest-1682549982 None] Lock "cinder-fb2ba2cd-08f3-47e7-be70-ef4c0ef57fec-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:46 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 1G" returned: 0 in 0.610s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:46 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 Sep 25 16:24:46 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:46 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339" returned: 0 in 0.342s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:46 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 is being set with open permissions: ugo+rw Sep 25 16:24:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:46 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 Sep 25 16:24:46 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:46 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339" returned: 0 in 0.304s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:46 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.info Sep 25 16:24:46 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:47 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.info" returned: 0 in 0.339s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:47 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.info is being set with open permissions: ugo+rw Sep 25 16:24:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:47 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.info Sep 25 16:24:47 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:47 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.info" returned: 0 in 0.347s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c3f5cf38-4e6f-498f-b02f-99c2bdca9a84 tempest-VolumeDependencyTests-1790962001 None] Create snapshot completed successfully Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Flow 'volume_create_manager' (23486bd3-c6ea-471c-b9b2-ea10c71284a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f8edc5-a0f9-45e6-8ee0-0ed71adcc945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f8edc5-a0f9-45e6-8ee0-0ed71adcc945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-570495695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac01ab81-6751-4b0e-aaf5-658b687a3baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f468514ccda44df29109aca263c1f17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2e0a45b-f618-4c7b-a8e5-677170e56339,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:49Z,use_quota=True,user_id='413d0458815f446f9c072b3aad304b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84754a0a-c260-422a-80f4-c6098922f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84754a0a-c260-422a-80f4-c6098922f264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e1ac47-1021-43e4-ad91-d006530b0c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e1ac47-1021-43e4-ad91-d006530b0c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac01ab81-6751-4b0e-aaf5-658b687a3baf', 'volume_name': 'volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf', 'volume_size': 1, 'snapshot_id': 'a2e0a45b-f618-4c7b-a8e5-677170e56339'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ceeb005-73c2-4bd0-9d1f-11c796eee85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ceeb005-73c2-4bd0-9d1f-11c796eee85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd922122-51d9-4a26-b606-f8e43425984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Volume ac01ab81-6751-4b0e-aaf5-658b687a3baf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf', 'volume_size': 1, 'snapshot_id': 'a2e0a45b-f618-4c7b-a8e5-677170e56339'} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-quobyte-a2e0a45b-f618-4c7b-a8e5-677170e56339-ac01ab81-6751-4b0e-aaf5-658b687a3baf" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-a2e0a45b-f618-4c7b-a8e5-677170e56339-ac01ab81-6751-4b0e-aaf5-658b687a3baf" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Creating volume ac01ab81-6751-4b0e-aaf5-658b687a3baf from snapshot a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-quobyte-ac01ab81-6751-4b0e-aaf5-658b687a3baf" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-ac01ab81-6751-4b0e-aaf5-658b687a3baf" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] snapshot: a2e0a45b-f618-4c7b-a8e5-677170e56339, volume: ac01ab81-6751-4b0e-aaf5-658b687a3baf, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7e0855-1f4a-413c-ad09-c73dd67a6c8b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:49 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 Sep 25 16:24:49 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:49 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339" returned: 0 in 0.474s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89cf90d8-3230-423a-89b1-8bbcb6befa64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1736840a-8d52-462b-98ad-5fd50329f9e8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:49 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 Sep 25 16:24:49 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:50 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64" returned: 0 in 0.496s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:24:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:24:50 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:24:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:50 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf Sep 25 16:24:50 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:52 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:24:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Flow 'volume_create_manager' (ccb36ee7-749c-4395-89cc-3b59185a12ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a013df94-9b52-4c15-afba-260025d1dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a013df94-9b52-4c15-afba-260025d1dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780901004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8caff557-2f1b-42e1-96f2-ca95cfbdbbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a905bec444c491b9270ef4bcf89d920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:53Z,use_quota=True,user_id='00f65f7183ba466582761d9d837bbef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c541863-0dc0-4004-9003-117202e58b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c541863-0dc0-4004-9003-117202e58b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edf1497-a662-43b5-9846-bf6b21e95389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edf1497-a662-43b5-9846-bf6b21e95389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8caff557-2f1b-42e1-96f2-ca95cfbdbbce', 'volume_name': 'volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b468c1-a80b-47df-9063-49c109384cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b468c1-a80b-47df-9063-49c109384cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66c68f1-0cab-4af5-8eb2-8d96451537d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Volume 8caff557-2f1b-42e1-96f2-ca95cfbdbbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce', 'volume_size': 1} Sep 25 16:24:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:57 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf" returned: 0 in 7.528s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:57 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:24:57 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Converted 1024.00 MB image at 136.01 MB/s Sep 25 16:24:57 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf is being set with open permissions: ugo+rw Sep 25 16:24:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:57 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf Sep 25 16:24:57 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:57 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf" returned: 0 in 0.329s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-ac01ab81-6751-4b0e-aaf5-658b687a3baf" released by "_copy_volume_from_snapshot" :: held 8.948s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-a2e0a45b-f618-4c7b-a8e5-677170e56339-ac01ab81-6751-4b0e-aaf5-658b687a3baf" released by "_create_volume_from_snapshot" :: held 9.025s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.044s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780901004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8caff557-2f1b-42e1-96f2-ca95cfbdbbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a905bec444c491b9270ef4bcf89d920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:24:53Z,use_quota=True,user_id='00f65f7183ba466582761d9d837bbef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Creating volume 8caff557-2f1b-42e1-96f2-ca95cfbdbbce {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:24:58 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:58 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce 1073741824 Sep 25 16:24:58 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd922122-51d9-4a26-b606-f8e43425984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf', 'volume_size': 1, 'snapshot_id': 'a2e0a45b-f618-4c7b-a8e5-677170e56339'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1996fed-035b-434b-b619-05abb651082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Volume volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf (ac01ab81-6751-4b0e-aaf5-658b687a3baf): created successfully Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1996fed-035b-434b-b619-05abb651082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Flow 'volume_create_manager' (23486bd3-c6ea-471c-b9b2-ea10c71284a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-dbc4b9ca-949b-4708-92c4-16daebaf4bfa tempest-VolumeDependencyTests-1790962001 None] Created volume successfully. Sep 25 16:24:58 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce 1073741824" returned: 0 in 0.508s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:58 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce Sep 25 16:24:58 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:58 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce" returned: 0 in 0.368s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:24:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66c68f1-0cab-4af5-8eb2-8d96451537d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367be2f8-231b-4a0a-a74d-14a30c715a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-a2e0a45b-f618-4c7b-a8e5-677170e56339-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:59 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Volume volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce (8caff557-2f1b-42e1-96f2-ca95cfbdbbce): created successfully Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367be2f8-231b-4a0a-a74d-14a30c715a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Flow 'volume_create_manager' (ccb36ee7-749c-4395-89cc-3b59185a12ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-a2e0a45b-f618-4c7b-a8e5-677170e56339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-quobyte-89cf90d8-3230-423a-89b1-8bbcb6befa64" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-85d12592-a3dc-4e5a-8780-02cdf39057c8 tempest-ProjectReaderTests-18673669 None] Created volume successfully. Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-89cf90d8-3230-423a-89b1-8bbcb6befa64" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-quobyte-a2e0a45b-f618-4c7b-a8e5-677170e56339" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-a2e0a45b-f618-4c7b-a8e5-677170e56339" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Deleting offline snapshot a2e0a45b-f618-4c7b-a8e5-677170e56339 of volume 89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] snapshot_file for this snap is: volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d39a53-75cf-4824-ac86-6e753560ce9c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:59 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 Sep 25 16:24:59 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:24:59 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339" returned: 0 in 0.455s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89cf90d8-3230-423a-89b1-8bbcb6befa64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c845c-c435-4cce-8220-41e484f64c77]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:24:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:24:59 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 Sep 25 16:24:59 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:00 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64" returned: 0 in 0.742s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:00 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 Sep 25 16:25:00 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Acquiring lock "cinder-8caff557-2f1b-42e1-96f2-ca95cfbdbbce-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Lock "cinder-8caff557-2f1b-42e1-96f2-ca95cfbdbbce-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Acquiring lock "cinder-quobyte-8caff557-2f1b-42e1-96f2-ca95cfbdbbce" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Lock "cinder-quobyte-8caff557-2f1b-42e1-96f2-ca95cfbdbbce" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f4b0b9-4cfd-4bb8-8cde-9c3c441750bf]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:00 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce Sep 25 16:25:00 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:01 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339" returned: 0 in 0.611s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:01 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339 Sep 25 16:25:01 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:01 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce" returned: 0 in 0.583s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:01 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce Sep 25 16:25:01 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:01 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64.a2e0a45b-f618-4c7b-a8e5-677170e56339" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-a2e0a45b-f618-4c7b-a8e5-677170e56339" released by "_delete_snapshot" :: held 2.391s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-89cf90d8-3230-423a-89b1-8bbcb6befa64" released by "delete_snapshot" :: held 2.429s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Created reservations ['81cfc555-2253-48d6-bdb3-f54ed20ad3af', 'def2b849-0a10-413c-92cf-0bd82ba850d4', '363b8c7f-5b7f-4b36-a86e-e8e2de135762', 'a2841af2-c2a3-4a13-b8d2-0744896fc935'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Delete snapshot completed successfully. Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4526817f-3932-423c-a32f-de2ee15b7c7b tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-a2e0a45b-f618-4c7b-a8e5-677170e56339-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:01 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8caff557-2f1b-42e1-96f2-ca95cfbdbbce" returned: 0 in 0.404s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Lock "cinder-quobyte-8caff557-2f1b-42e1-96f2-ca95cfbdbbce" released by "delete_volume" :: held 1.076s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Created reservations ['2b52be00-e755-471f-9f57-355a4ee03394', 'a8e5baed-f276-4208-9abe-9b82f88750f2', 'f80696ee-67aa-43c9-b12b-244c1e54dfc0', '782379ea-f239-4c90-8bb7-93a200346252'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:02 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:25:02 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-89cf90d8-3230-423a-89b1-8bbcb6befa64-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-89cf90d8-3230-423a-89b1-8bbcb6befa64-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:02 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-quobyte-89cf90d8-3230-423a-89b1-8bbcb6befa64" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:02 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Deleted volume successfully. Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-89cf90d8-3230-423a-89b1-8bbcb6befa64" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c8326796-e6ca-4946-ac7d-2bd14bd00b14 tempest-ProjectReaderTests-18673669 None] Lock "cinder-8caff557-2f1b-42e1-96f2-ca95cfbdbbce-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c865123c-315e-4b32-be25-6c0df16af17d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:02 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 Sep 25 16:25:02 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:03 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64" returned: 0 in 0.508s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:03 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64 Sep 25 16:25:03 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:03 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-89cf90d8-3230-423a-89b1-8bbcb6befa64" returned: 0 in 0.375s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-89cf90d8-3230-423a-89b1-8bbcb6befa64" released by "delete_volume" :: held 0.990s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Created reservations ['4d556785-983c-4c3b-b173-ce166d140f4c', 'b8a78fa2-9b70-448b-aa03-7b89270ada4d', '71d35032-b5d5-49ba-93b1-0fefecb72372', '268ac575-257a-459e-90c2-0f60f8e575f1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Flow 'volume_create_manager' (32691676-100a-43c6-9391-fcecce053370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c29252-10a6-4746-b3f8-84e26d266208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:03 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:25:03 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c29252-10a6-4746-b3f8-84e26d266208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683533971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efd5bc5-cb16-4f72-b0c0-31277d24c2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a905bec444c491b9270ef4bcf89d920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:04Z,use_quota=True,user_id='00f65f7183ba466582761d9d837bbef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d415d61-1161-4ccc-baee-f270a00ceb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d415d61-1161-4ccc-baee-f270a00ceb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bf3edf-e9cf-461a-ad1d-26428bd4e1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bf3edf-e9cf-461a-ad1d-26428bd4e1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3efd5bc5-cb16-4f72-b0c0-31277d24c2cd', 'volume_name': 'volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6323b2-1e41-4c56-9e21-027a57a0175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6323b2-1e41-4c56-9e21-027a57a0175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c15e955-7542-4815-a3cb-ee35ed9f54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:03 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Volume 3efd5bc5-cb16-4f72-b0c0-31277d24c2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd', 'volume_size': 1} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683533971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efd5bc5-cb16-4f72-b0c0-31277d24c2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a905bec444c491b9270ef4bcf89d920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:04Z,use_quota=True,user_id='00f65f7183ba466582761d9d837bbef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Creating volume 3efd5bc5-cb16-4f72-b0c0-31277d24c2cd {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:03 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:25:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:03 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd 1073741824 Sep 25 16:25:03 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:04 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.324s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Deleted volume successfully. Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-23a3352e-338e-43b3-88ee-934037a5398c tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-89cf90d8-3230-423a-89b1-8bbcb6befa64-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:04 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd 1073741824" returned: 0 in 0.535s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:04 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd Sep 25 16:25:04 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-ac01ab81-6751-4b0e-aaf5-658b687a3baf-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-ac01ab81-6751-4b0e-aaf5-658b687a3baf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "cinder-quobyte-ac01ab81-6751-4b0e-aaf5-658b687a3baf" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:04 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-ac01ab81-6751-4b0e-aaf5-658b687a3baf" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd" returned: 0 in 0.356s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f00e7-616e-42b6-afff-43047b312fc7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c15e955-7542-4815-a3cb-ee35ed9f54b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3ffa8d-8683-448f-bec1-4bf1fbe40253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:04 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Volume volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd (3efd5bc5-cb16-4f72-b0c0-31277d24c2cd): created successfully Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3ffa8d-8683-448f-bec1-4bf1fbe40253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:04 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Flow 'volume_create_manager' (32691676-100a-43c6-9391-fcecce053370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7bd5c94c-ef27-437c-be0c-2ed9ccaad0e6 tempest-ProjectReaderTests-18673669 None] Created volume successfully. Sep 25 16:25:04 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf Sep 25 16:25:04 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:05 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf" returned: 0 in 0.406s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:05 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf Sep 25 16:25:05 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:05 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ac01ab81-6751-4b0e-aaf5-658b687a3baf" returned: 0 in 0.378s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-quobyte-ac01ab81-6751-4b0e-aaf5-658b687a3baf" released by "delete_volume" :: held 0.841s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Created reservations ['15725f94-31d9-4de3-b4a1-c96e9a675bf3', 'f2a86fc9-ebdb-4b79-87f6-24a7a5472021', '74aeed27-bb89-441e-91fe-98f462774adb', '0e24bb0a-5b2d-4f03-9b17-7e741a9c611c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:05 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:25:05 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Acquiring lock "cinder-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Lock "cinder-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Acquiring lock "cinder-quobyte-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Lock "cinder-quobyte-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a3434-4ed8-4dbd-bb03-3a5519fb5942]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:06 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.369s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Deleted volume successfully. Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0cf3f606-201e-4f61-837e-890c7a2ebb5f tempest-VolumeDependencyTests-1790962001 None] Lock "cinder-ac01ab81-6751-4b0e-aaf5-658b687a3baf-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:06 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd Sep 25 16:25:06 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:06 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd" returned: 0 in 0.568s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:06 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd Sep 25 16:25:06 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:07 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd" returned: 0 in 0.325s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Lock "cinder-quobyte-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd" released by "delete_volume" :: held 0.969s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Created reservations ['b179ed4d-b8e9-47c6-8762-fa2c8532d3b1', '50ae1dcf-8a66-406d-8efa-46baa04c7402', '84f60539-481b-4ccf-b839-9a4743495fcb', '2842d4c9-0f05-4e85-8097-623bc8469bab'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:07 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:25:07 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:07 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.335s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:07 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Deleted volume successfully. Sep 25 16:25:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-27df5cfd-7d67-47ee-8237-0cc2e05f6f7b tempest-ProjectReaderTests-18673669 None] Lock "cinder-3efd5bc5-cb16-4f72-b0c0-31277d24c2cd-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:15 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:25:15 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:15 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.382s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:25:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:25:17 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:INSERT=52,cinder:UPDATE=187,cinder:SELECT=133,cinder:DELETE=14 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:17 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=134,cinder:INSERT=47,cinder:UPDATE=183,cinder:DELETE=17 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Flow 'volume_create_manager' (1455556d-8dab-46a5-95ea-9ef8570c99e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6cedd1-c43c-4518-83cd-78b1ebe66935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6cedd1-c43c-4518-83cd-78b1ebe66935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-33315799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0587385f-2beb-4c12-a13e-b74e26c9c7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88950bb5590a4e7d9c9a8d439b0468e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:21Z,use_quota=True,user_id='60aacabf244d46ec843a686d76f50d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb2ed61-a6df-4180-a444-62a9d379901b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb2ed61-a6df-4180-a444-62a9d379901b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afb2581-23f8-4476-9cdc-fdd904854178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afb2581-23f8-4476-9cdc-fdd904854178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0587385f-2beb-4c12-a13e-b74e26c9c7a4', 'volume_name': 'volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c806f208-70e5-4f55-a87f-3400979102b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c806f208-70e5-4f55-a87f-3400979102b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7d4af-7f05-4cdc-b3ec-37918c023e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Volume 0587385f-2beb-4c12-a13e-b74e26c9c7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4', 'volume_size': 1} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-33315799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0587385f-2beb-4c12-a13e-b74e26c9c7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88950bb5590a4e7d9c9a8d439b0468e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:25:21Z,use_quota=True,user_id='60aacabf244d46ec843a686d76f50d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Creating volume 0587385f-2beb-4c12-a13e-b74e26c9c7a4 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:25:20 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:25:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:20 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 1073741824 Sep 25 16:25:20 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:21 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 1073741824" returned: 0 in 0.466s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:21 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 Sep 25 16:25:21 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:21 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4" returned: 0 in 0.249s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7d4af-7f05-4cdc-b3ec-37918c023e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54b4575-ab96-4624-9ec2-4f83e2244205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:25:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Volume volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 (0587385f-2beb-4c12-a13e-b74e26c9c7a4): created successfully Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54b4575-ab96-4624-9ec2-4f83e2244205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:25:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Flow 'volume_create_manager' (1455556d-8dab-46a5-95ea-9ef8570c99e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:25:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-73ff0d72-76c3-4847-a3bc-d55af679e7a3 tempest-TestImageHashVerification-748657763 None] Created volume successfully. Sep 25 16:25:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:23 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b03fa-cc57-4ad5-9b8d-92141ead0d19]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:23 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 Sep 25 16:25:23 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:24 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4" returned: 0 in 0.401s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[04958ecd-b828-4fcc-9d2d-fbd63918ba03]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:24 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 Sep 25 16:25:24 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:24 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4" returned: 0 in 0.432s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 /opt/stack/data/cinder/conversion/0587385f-2beb-4c12-a13e-b74e26c9c7a4.temp_image.0f8b0397-08e3-4ccc-b7be-ee19f518f94ct917d2x5.img {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:24 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 /opt/stack/data/cinder/conversion/0587385f-2beb-4c12-a13e-b74e26c9c7a4.temp_image.0f8b0397-08e3-4ccc-b7be-ee19f518f94ct917d2x5.img Sep 25 16:25:24 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:30 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 /opt/stack/data/cinder/conversion/0587385f-2beb-4c12-a13e-b74e26c9c7a4.temp_image.0f8b0397-08e3-4ccc-b7be-ee19f518f94ct917d2x5.img" returned: 0 in 5.947s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb36fdf9-9d14-40c4-be72-c2a172aa034e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:30 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 Sep 25 16:25:30 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:31 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4" returned: 0 in 0.582s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:31 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/conversion/0587385f-2beb-4c12-a13e-b74e26c9c7a4.temp_image.0f8b0397-08e3-4ccc-b7be-ee19f518f94ct917d2x5.img {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:25:31 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Converted 1024.00 MB image at 172.16 MB/s Sep 25 16:25:31 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] 0f8b0397-08e3-4ccc-b7be-ee19f518f94c was raw, no need to convert to raw {{(pid=87467) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1183}} Sep 25 16:25:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1,cinder:SELECT=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:25:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.532s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Uploaded volume to glance image-id: 0f8b0397-08e3-4ccc-b7be-ee19f518f94c. {{(pid=87467) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 16:25:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-229d96f0-e227-4897-90c5-cc2af7cb6294 tempest-TestImageHashVerification-748657763 None] Copy volume to image completed successfully. Sep 25 16:25:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Acquiring lock "cinder-0587385f-2beb-4c12-a13e-b74e26c9c7a4-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Lock "cinder-0587385f-2beb-4c12-a13e-b74e26c9c7a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Acquiring lock "cinder-quobyte-0587385f-2beb-4c12-a13e-b74e26c9c7a4" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:25:52 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Lock "cinder-quobyte-0587385f-2beb-4c12-a13e-b74e26c9c7a4" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:25:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[680130c7-ce66-4168-ad79-1e7982e40ffd]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:25:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:52 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 Sep 25 16:25:52 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:53 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4" returned: 0 in 0.385s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:53 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4 Sep 25 16:25:53 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:53 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0587385f-2beb-4c12-a13e-b74e26c9c7a4" returned: 0 in 0.264s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Lock "cinder-quobyte-0587385f-2beb-4c12-a13e-b74e26c9c7a4" released by "delete_volume" :: held 0.694s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Created reservations ['aea010e5-4260-4270-a866-cd0cff577909', '57b3c6f3-fbe4-4377-b654-d5c48b5a5637', '48676d34-3987-4d58-9a77-04ee06daa29f', '7e858c94-e833-4cc3-8ea7-3fe64857afc5'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:25:53 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:25:53 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:25:53 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.301s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:25:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Deleted volume successfully. Sep 25 16:25:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fce02f52-2677-453d-91ca-4ed101f79a04 tempest-TestImageHashVerification-748657763 None] Lock "cinder-0587385f-2beb-4c12-a13e-b74e26c9c7a4-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:03 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:03 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Flow 'volume_create_manager' (94609412-eed6-4706-a556-bbacd78465b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff23e3b-c99f-4fcd-a81d-512262b82286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff23e3b-c99f-4fcd-a81d-512262b82286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d7c0d1-39d1-45b9-8555-8351b22fffaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18066c6e95714d9296f273f4698cbf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:09Z,use_quota=True,user_id='dc875fa90a8f48a5a4f49e05cb3954f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3355f322-3739-464a-8a4c-5b0c99358c37),volume_type_id=3355f322-3739-464a-8a4c-5b0c99358c37)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82143153-f579-4945-8c73-25688eab12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82143153-f579-4945-8c73-25688eab12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253f0739-9cbb-4aca-8671-89c44998bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253f0739-9cbb-4aca-8671-89c44998bf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6d7c0d1-39d1-45b9-8555-8351b22fffaa', 'volume_name': 'volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa', 'volume_size': 1, 'image_id': '30ae80e1-e612-45f2-878b-f43816802d15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30ae80e1-e612-45f2-878b-f43816802d15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1f91b4d57b6106ed21a4aa81a515c8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '18066c6e95714d9296f273f4698cbf82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c4caee7af9636c577849392d4c7331c1c36acc5f3d07c58235be3a2ce14bbbaba62eb1ffa13e993166819105d01e9a9e0c124330352e03d9d45cc949081e3c25', 'id': '30ae80e1-e612-45f2-878b-f43816802d15', 'created_at': datetime.datetime(2026, 9, 25, 14, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30ae80e1-e612-45f2-878b-f43816802d15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff54363-2240-4a05-b98d-3ad915a97e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff54363-2240-4a05-b98d-3ad915a97e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb79a4e-05b7-43dc-b3d8-9dcae3685124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:09 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Volume a6d7c0d1-39d1-45b9-8555-8351b22fffaa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa', 'volume_size': 1, 'image_id': '30ae80e1-e612-45f2-878b-f43816802d15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30ae80e1-e612-45f2-878b-f43816802d15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1f91b4d57b6106ed21a4aa81a515c8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '18066c6e95714d9296f273f4698cbf82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c4caee7af9636c577849392d4c7331c1c36acc5f3d07c58235be3a2ce14bbbaba62eb1ffa13e993166819105d01e9a9e0c124330352e03d9d45cc949081e3c25', 'id': '30ae80e1-e612-45f2-878b-f43816802d15', 'created_at': datetime.datetime(2026, 9, 25, 14, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30ae80e1-e612-45f2-878b-f43816802d15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Trying to clone a6d7c0d1-39d1-45b9-8555-8351b22fffaa from image 30ae80e1-e612-45f2-878b-f43816802d15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30ae80e1-e612-45f2-878b-f43816802d15', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:26:09 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[097536a3-280d-4792-a3be-ba4221bc9914]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:09 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD Sep 25 16:26:09 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:10 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:10 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD Sep 25 16:26:10 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:10 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Temporary image 30ae80e1-e612-45f2-878b-f43816802d15 is fetched for user dc875fa90a8f48a5a4f49e05cb3954f8. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a3f5ca-26da-417e-b168-d58c8f9de23c]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:10 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD Sep 25 16:26:10 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:10 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:10 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD Sep 25 16:26:10 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:11 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d7c0d1-39d1-45b9-8555-8351b22fffaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18066c6e95714d9296f273f4698cbf82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:09Z,use_quota=True,user_id='dc875fa90a8f48a5a4f49e05cb3954f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3355f322-3739-464a-8a4c-5b0c99358c37),volume_type_id=3355f322-3739-464a-8a4c-5b0c99358c37)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Creating volume a6d7c0d1-39d1-45b9-8555-8351b22fffaa {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:11 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:11 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa 1073741824 Sep 25 16:26:11 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:11 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa 1073741824" returned: 0 in 0.448s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:11 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa Sep 25 16:26:11 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:11 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa" returned: 0 in 0.258s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:11 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Attempting download of 30ae80e1-e612-45f2-878b-f43816802d15 ((None, [{'url': 'file:///opt/stack/data/glance/images/30ae80e1-e612-45f2-878b-f43816802d15', 'metadata': {}}])) to volume a6d7c0d1-39d1-45b9-8555-8351b22fffaa. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c97161-1645-4e3f-b506-27ac010b291d]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30ae80e1-e612-45f2-878b-f43816802d15_jz08vh30 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:12 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30ae80e1-e612-45f2-878b-f43816802d15_jz08vh30 Sep 25 16:26:12 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:12 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30ae80e1-e612-45f2-878b-f43816802d15_jz08vh30" returned: 0 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ae80e1-e612-45f2-878b-f43816802d15_jz08vh30 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:12 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ae80e1-e612-45f2-878b-f43816802d15_jz08vh30 Sep 25 16:26:12 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:12 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ae80e1-e612-45f2-878b-f43816802d15_jz08vh30" returned: 1 in 0.366s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30ae80e1-e612-45f2-878b-f43816802d15_jz08vh30' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eccaa9c-f80d-4e43-9970-cd27b6025e2a]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:12 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD Sep 25 16:26:12 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:13 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:13 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD Sep 25 16:26:13 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:13 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:26:13 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] 30ae80e1-e612-45f2-878b-f43816802d15 was raw, converting to qcow2 {{(pid=87467) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 25 16:26:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:13 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa Sep 25 16:26:13 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:14 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa" returned: 0 in 0.460s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30ae80e1-e612-45f2-878b-f43816802d15_04k3v3_8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:26:14 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:14 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa 1G Sep 25 16:26:14 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:14 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa 1G" returned: 0 in 0.363s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Downloaded image 30ae80e1-e612-45f2-878b-f43816802d15 ((None, [{'url': 'file:///opt/stack/data/glance/images/30ae80e1-e612-45f2-878b-f43816802d15', 'metadata': {}}])) to volume a6d7c0d1-39d1-45b9-8555-8351b22fffaa successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Temporary image 30ae80e1-e612-45f2-878b-f43816802d15 for user dc875fa90a8f48a5a4f49e05cb3954f8 is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Marking volume a6d7c0d1-39d1-45b9-8555-8351b22fffaa as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Copying metadata from image 30ae80e1-e612-45f2-878b-f43816802d15 to a6d7c0d1-39d1-45b9-8555-8351b22fffaa. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Creating volume glance metadata for volume a6d7c0d1-39d1-45b9-8555-8351b22fffaa backed by image 30ae80e1-e612-45f2-878b-f43816802d15 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '30ae80e1-e612-45f2-878b-f43816802d15', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c1f91b4d57b6106ed21a4aa81a515c8f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb79a4e-05b7-43dc-b3d8-9dcae3685124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa', 'volume_size': 1, 'image_id': '30ae80e1-e612-45f2-878b-f43816802d15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30ae80e1-e612-45f2-878b-f43816802d15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1f91b4d57b6106ed21a4aa81a515c8f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '18066c6e95714d9296f273f4698cbf82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c4caee7af9636c577849392d4c7331c1c36acc5f3d07c58235be3a2ce14bbbaba62eb1ffa13e993166819105d01e9a9e0c124330352e03d9d45cc949081e3c25', 'id': '30ae80e1-e612-45f2-878b-f43816802d15', 'created_at': datetime.datetime(2026, 9, 25, 14, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30ae80e1-e612-45f2-878b-f43816802d15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745c9014-dc33-48f9-8677-24fe4cfe8170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:14 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Volume volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa (a6d7c0d1-39d1-45b9-8555-8351b22fffaa): created successfully Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745c9014-dc33-48f9-8677-24fe4cfe8170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:14 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Flow 'volume_create_manager' (94609412-eed6-4706-a556-bbacd78465b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:14 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9e1e53ca-27d7-4c59-a0ba-ac536cda1060 tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Created volume successfully. Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:15 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:15 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Acquiring lock "cinder-a6d7c0d1-39d1-45b9-8555-8351b22fffaa-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "cinder-a6d7c0d1-39d1-45b9-8555-8351b22fffaa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Acquiring lock "cinder-quobyte-a6d7c0d1-39d1-45b9-8555-8351b22fffaa" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "cinder-quobyte-a6d7c0d1-39d1-45b9-8555-8351b22fffaa" acquired by "delete_volume" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c9f96-a81d-43c8-bd7f-866ff0315a96]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:15 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.331s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:26:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:26:15 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa Sep 25 16:26:15 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:16 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa" returned: 0 in 0.426s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:16 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa Sep 25 16:26:16 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:16 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a6d7c0d1-39d1-45b9-8555-8351b22fffaa" returned: 0 in 0.261s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "cinder-quobyte-a6d7c0d1-39d1-45b9-8555-8351b22fffaa" released by "delete_volume" :: held 0.739s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:16 devstack cinder-volume[87467]: WARNING cinder.quota [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:26:16 devstack cinder-volume[87467]: WARNING cinder.quota [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Created reservations ['7aaed739-0776-4e5d-9551-a1f28babeaa0', '93403667-3488-4e00-9717-202381be74b8', '81c732aa-d61c-4d18-8e7b-541537a58613', '81364349-0981-46bd-aed3-e2c27b9b8ff6'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:16 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:16 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:16 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.291s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Deleted volume successfully. Sep 25 16:26:16 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a912a12b-d4a3-4287-ad09-f99300a770fd tempest-VolumeAndVolumeTypeFromImageTest-1131019404 None] Lock "cinder-a6d7c0d1-39d1-45b9-8555-8351b22fffaa-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (b1d66bd7-f11c-4244-8927-543ea4860496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89c4881-4a93-42e0-89ab-f373443a9285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89c4881-4a93-42e0-89ab-f373443a9285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122762795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efc8cf0-09ba-46de-955c-cdf5d0a59bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:21Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76281e6f-21e4-482a-825c-23fb0cebdf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76281e6f-21e4-482a-825c-23fb0cebdf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98385d4-1300-49a4-9f68-79a6e4b2ad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98385d4-1300-49a4-9f68-79a6e4b2ad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efc8cf0-09ba-46de-955c-cdf5d0a59bd3', 'volume_name': 'volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632046d0-cde7-411d-bb10-d2ffd0796314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632046d0-cde7-411d-bb10-d2ffd0796314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510980b9-1340-4213-8102-3b9039636b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume 4efc8cf0-09ba-46de-955c-cdf5d0a59bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3', 'volume_size': 1} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122762795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efc8cf0-09ba-46de-955c-cdf5d0a59bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:21Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Creating volume 4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:21 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:21 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 1073741824 Sep 25 16:26:21 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:22 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 1073741824" returned: 0 in 0.493s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:22 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 Sep 25 16:26:22 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:22 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" returned: 0 in 0.292s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510980b9-1340-4213-8102-3b9039636b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277ed989-9969-474b-b3cd-82cbca42cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:22 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 (4efc8cf0-09ba-46de-955c-cdf5d0a59bd3): created successfully Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277ed989-9969-474b-b3cd-82cbca42cd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:22 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (b1d66bd7-f11c-4244-8927-543ea4860496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:22 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8bc71347-eb30-47cf-9a99-dea67cbd1d0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created volume successfully. Sep 25 16:26:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Creating offline snapshot 23875e9e-b9b3-496d-bfb3-fb8726d0cb11 of volume 4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:26:23 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[569f04a8-9842-4689-a88d-2b194d70c795]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:23 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 Sep 25 16:26:23 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:24 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" returned: 0 in 0.368s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:24 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 1G Sep 25 16:26:24 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:24 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 1G" returned: 0 in 0.427s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:24 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 Sep 25 16:26:24 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:24 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11" returned: 0 in 0.314s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:24 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 is being set with open permissions: ugo+rw Sep 25 16:26:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:24 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 Sep 25 16:26:24 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:25 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11" returned: 0 in 0.260s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:25 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.info Sep 25 16:26:25 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:25 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.info" returned: 0 in 0.306s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:25 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.info is being set with open permissions: ugo+rw Sep 25 16:26:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:25 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.info Sep 25 16:26:25 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:25 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.info" returned: 0 in 0.246s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-462ddaf6-1f79-4e17-b89e-338b34e42e6f tempest-CreateVolumesFromSnapshotTest-1566092728 None] Create snapshot completed successfully Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (c234df62-e8ff-4ed4-a2a0-40642b7df3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ed71c6-70bf-45bb-9b9b-ae4e27c3cdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ed71c6-70bf-45bb-9b9b-ae4e27c3cdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91927285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc3abfc-7cba-4551-abd5-86e2ba6b3d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:27Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7c3c1b-347e-4793-bc3e-d16a0b81f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7c3c1b-347e-4793-bc3e-d16a0b81f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0491472f-7e56-49de-b6dc-f2c07f005e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0491472f-7e56-49de-b6dc-f2c07f005e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc3abfc-7cba-4551-abd5-86e2ba6b3d83', 'volume_name': 'volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5013a9b8-d430-445f-bdb5-01d1ca8e6504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5013a9b8-d430-445f-bdb5-01d1ca8e6504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1650b1-5bbd-4534-9cc9-37241bbd688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume 4dc3abfc-7cba-4551-abd5-86e2ba6b3d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83', 'volume_size': 1} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91927285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc3abfc-7cba-4551-abd5-86e2ba6b3d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:27Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Creating volume 4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:27 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:27 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 1073741824 Sep 25 16:26:27 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (c1ff0932-dffe-4c2f-ac9c-928985851849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73281550-1d85-4812-8314-eb9064d4c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73281550-1d85-4812-8314-eb9064d4c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-976845493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1773afe9-38b5-4a99-a466-4ec5ad9a17d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:28Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c667dff-8d5d-4d31-966e-14f9b804ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c667dff-8d5d-4d31-966e-14f9b804ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd72285-3d29-492b-8dec-7d725d8c918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd72285-3d29-492b-8dec-7d725d8c918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1773afe9-38b5-4a99-a466-4ec5ad9a17d9', 'volume_name': 'volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a717639e-31a8-45eb-9d4c-2c963a59281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a717639e-31a8-45eb-9d4c-2c963a59281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf70dfbf-5164-40a9-9656-46dfea90ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume 1773afe9-38b5-4a99-a466-4ec5ad9a17d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9', 'volume_size': 1} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:27 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 1073741824" returned: 0 in 0.521s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:27 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 Sep 25 16:26:27 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (683ab89d-8fb4-40f9-b9b5-1b419c2e794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57db0e16-c2fd-475f-b65c-32847e0fc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57db0e16-c2fd-475f-b65c-32847e0fc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506442541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb259ab-bf18-48f9-a513-b1819aa275fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:28Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e113bb31-bf18-4570-9a67-3bc538722169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e113bb31-bf18-4570-9a67-3bc538722169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb85ebf-0074-4c3d-b6ac-cb5f762a8d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb85ebf-0074-4c3d-b6ac-cb5f762a8d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb259ab-bf18-48f9-a513-b1819aa275fd', 'volume_name': 'volume-7fb259ab-bf18-48f9-a513-b1819aa275fd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb50cfbe-1440-4439-b500-89a42d0bf990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb50cfbe-1440-4439-b500-89a42d0bf990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee232f22-42f1-47b9-83c3-b5239f9ea190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume 7fb259ab-bf18-48f9-a513-b1819aa275fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb259ab-bf18-48f9-a513-b1819aa275fd', 'volume_size': 1} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:28 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83" returned: 0 in 0.327s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-976845493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1773afe9-38b5-4a99-a466-4ec5ad9a17d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:28Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Creating volume 1773afe9-38b5-4a99-a466-4ec5ad9a17d9 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:28 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1650b1-5bbd-4534-9cc9-37241bbd688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 1073741824 Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e15583-ba1d-4b2e-9dbe-8c2121448073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 (4dc3abfc-7cba-4551-abd5-86e2ba6b3d83): created successfully Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e15583-ba1d-4b2e-9dbe-8c2121448073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (c234df62-e8ff-4ed4-a2a0-40642b7df3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-adcd4a5a-59b9-4910-9020-ee43c3ff5af0 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created volume successfully. Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (fc1beb2f-f822-46be-a6ce-1af3e7c12507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c2c846-0453-4455-9db2-cef71e7e8f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c2c846-0453-4455-9db2-cef71e7e8f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946484355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7ca534-60d9-44ae-a6a8-acc701cdba07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:28Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5124819e-88bc-4119-8e16-0090a150917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5124819e-88bc-4119-8e16-0090a150917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513543c-9f0e-4d74-8b7c-6f1935111738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513543c-9f0e-4d74-8b7c-6f1935111738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7ca534-60d9-44ae-a6a8-acc701cdba07', 'volume_name': 'volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4711b7d-008a-4b4d-a0cf-30067a5b77c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4711b7d-008a-4b4d-a0cf-30067a5b77c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f142d5a1-2362-4c9d-84fb-3e744aac87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:28 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume 9f7ca534-60d9-44ae-a6a8-acc701cdba07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07', 'volume_size': 1} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:28 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 1073741824" returned: 0 in 0.565s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:28 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 Sep 25 16:26:28 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (e32f7340-8bb4-42a6-b603-5baf1c32a544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccceb93-c6eb-4fd8-8639-4fa3713b6ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccceb93-c6eb-4fd8-8639-4fa3713b6ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700065589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbd2ea6-97b4-45ee-a934-4c84d47fb134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:29Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dca774-4ccb-4987-b45d-56a97c2736a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dca774-4ccb-4987-b45d-56a97c2736a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a650b783-d413-452d-9400-5ac2a8ec052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a650b783-d413-452d-9400-5ac2a8ec052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbd2ea6-97b4-45ee-a934-4c84d47fb134', 'volume_name': 'volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d15593-0211-4fa3-8b47-51cd396f03cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d15593-0211-4fa3-8b47-51cd396f03cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f344905-d1bf-4d5d-950f-5c4f83061181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:29 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume ffbd2ea6-97b4-45ee-a934-4c84d47fb134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134', 'volume_size': 1} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:29 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9" returned: 0 in 0.277s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506442541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb259ab-bf18-48f9-a513-b1819aa275fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:28Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Creating volume 7fb259ab-bf18-48f9-a513-b1819aa275fd {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:29 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf70dfbf-5164-40a9-9656-46dfea90ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd 1073741824 Sep 25 16:26:29 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a806ce0-b943-4e09-89e5-d37bf57f6087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:29 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 (1773afe9-38b5-4a99-a466-4ec5ad9a17d9): created successfully Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a806ce0-b943-4e09-89e5-d37bf57f6087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (c1ff0932-dffe-4c2f-ac9c-928985851849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-99971041-5f4d-4413-a82f-89cfd295b483 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created volume successfully. Sep 25 16:26:29 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd 1073741824" returned: 0 in 0.495s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:29 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd Sep 25 16:26:29 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:29 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd" returned: 0 in 0.246s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.269s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946484355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7ca534-60d9-44ae-a6a8-acc701cdba07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:28Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Creating volume 9f7ca534-60d9-44ae-a6a8-acc701cdba07 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:29 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee232f22-42f1-47b9-83c3-b5239f9ea190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb259ab-bf18-48f9-a513-b1819aa275fd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 1073741824 Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e21386-47e9-4c59-9324-fbcbe420ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:29 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:29 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume volume-7fb259ab-bf18-48f9-a513-b1819aa275fd (7fb259ab-bf18-48f9-a513-b1819aa275fd): created successfully Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e21386-47e9-4c59-9324-fbcbe420ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (683ab89d-8fb4-40f9-b9b5-1b419c2e794d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-13e9439d-4762-41da-932f-8898843957ae tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created volume successfully. Sep 25 16:26:30 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 1073741824" returned: 0 in 0.478s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:30 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 Sep 25 16:26:30 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:30 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07" returned: 0 in 0.265s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700065589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbd2ea6-97b4-45ee-a934-4c84d47fb134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75a7c5b1fda4b679bdb6ae31e2dc607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:29Z,use_quota=True,user_id='fe9ad9db2bde47a8b0a6a9c642371b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Creating volume ffbd2ea6-97b4-45ee-a934-4c84d47fb134 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:30 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:30 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 1073741824 Sep 25 16:26:30 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f142d5a1-2362-4c9d-84fb-3e744aac87ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176bd423-b4a6-478e-a8b8-33130f7ef2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:30 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 (9f7ca534-60d9-44ae-a6a8-acc701cdba07): created successfully Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176bd423-b4a6-478e-a8b8-33130f7ef2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:30 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (fc1beb2f-f822-46be-a6ce-1af3e7c12507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7c5ecf4e-d07f-4672-ad91-fc84386ee1fb tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created volume successfully. Sep 25 16:26:31 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 1073741824" returned: 0 in 0.556s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:31 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 Sep 25 16:26:31 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:31 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134" returned: 0 in 0.264s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f344905-d1bf-4d5d-950f-5c4f83061181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7c0e29-73ea-4237-8912-5ebd73c0adb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:31 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Volume volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 (ffbd2ea6-97b4-45ee-a934-4c84d47fb134): created successfully Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7c0e29-73ea-4237-8912-5ebd73c0adb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Flow 'volume_create_manager' (e32f7340-8bb4-42a6-b603-5baf1c32a544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ace829c1-c449-40c1-a628-a0c43d0a2459 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created volume successfully. Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-ffbd2ea6-97b4-45ee-a934-4c84d47fb134-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-ffbd2ea6-97b4-45ee-a934-4c84d47fb134-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-ffbd2ea6-97b4-45ee-a934-4c84d47fb134" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-ffbd2ea6-97b4-45ee-a934-4c84d47fb134" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da15edd-71bd-4174-84a7-aeffe24d3f22]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:32 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 Sep 25 16:26:32 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:32 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134" returned: 0 in 0.391s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:32 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134 Sep 25 16:26:32 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:33 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ffbd2ea6-97b4-45ee-a934-4c84d47fb134" returned: 0 in 0.295s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-ffbd2ea6-97b4-45ee-a934-4c84d47fb134" released by "delete_volume" :: held 0.733s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created reservations ['82341004-d75e-4654-aa99-c5190b8006c6', '3a2aa2e0-db59-4135-992f-8ab731e10ce4', 'c4aba1b4-e2f1-45aa-a644-c5204c2e08b1', 'cf4b6f25-134b-48e6-9864-abf264e4513f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:33 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:33 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-9f7ca534-60d9-44ae-a6a8-acc701cdba07-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-9f7ca534-60d9-44ae-a6a8-acc701cdba07-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:33 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.301s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Deleted volume successfully. Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-9f7ca534-60d9-44ae-a6a8-acc701cdba07" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4bfb1606-337c-4689-a4f0-5eb2f43530c4 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-ffbd2ea6-97b4-45ee-a934-4c84d47fb134-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-9f7ca534-60d9-44ae-a6a8-acc701cdba07" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0bb7d-2dae-4f1a-97ba-5954b47103c5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:33 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 Sep 25 16:26:33 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:34 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07" returned: 0 in 0.385s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:34 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07 Sep 25 16:26:34 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:34 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9f7ca534-60d9-44ae-a6a8-acc701cdba07" returned: 0 in 0.271s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-9f7ca534-60d9-44ae-a6a8-acc701cdba07" released by "delete_volume" :: held 0.700s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created reservations ['a0564596-4cf4-42e1-96f7-7f47461a1776', '40c114e3-62a8-4c4f-a827-06c076f891c1', '65e799c0-b68f-4aee-bb1c-3fff3c5757be', 'f0eeefef-e83f-4898-aaa9-d69b2f71d7a2'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:34 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:34 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:34 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-7fb259ab-bf18-48f9-a513-b1819aa275fd-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.290s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Deleted volume successfully. Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-7fb259ab-bf18-48f9-a513-b1819aa275fd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ad065de3-ce66-4d32-8989-dea65e38380c tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-9f7ca534-60d9-44ae-a6a8-acc701cdba07-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-7fb259ab-bf18-48f9-a513-b1819aa275fd" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-7fb259ab-bf18-48f9-a513-b1819aa275fd" acquired by "delete_volume" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb3f4e-c5ec-4f3d-b3b0-9540a2dfa477]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:35 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd Sep 25 16:26:35 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:35 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd" returned: 0 in 0.376s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:35 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd Sep 25 16:26:35 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:35 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7fb259ab-bf18-48f9-a513-b1819aa275fd" returned: 0 in 0.256s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-7fb259ab-bf18-48f9-a513-b1819aa275fd" released by "delete_volume" :: held 0.677s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created reservations ['5d4a1db1-039d-4f77-9416-141b1a3ceb8b', '0183878b-5802-4014-86ed-8713a530e123', '9ef326b3-e691-4bb1-ac70-7b4898d176e4', '229f730e-1a41-4841-aeb7-6bbb7fa8b07b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:35 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:35 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:36 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.273s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-1773afe9-38b5-4a99-a466-4ec5ad9a17d9-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Deleted volume successfully. Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-1773afe9-38b5-4a99-a466-4ec5ad9a17d9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1c9d7b41-2b7f-4b0c-b504-9e0bb1b5b18e tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-7fb259ab-bf18-48f9-a513-b1819aa275fd-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-1773afe9-38b5-4a99-a466-4ec5ad9a17d9" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-1773afe9-38b5-4a99-a466-4ec5ad9a17d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4d3009-fe32-4d9a-9168-4e7c9cda9810]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:36 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 Sep 25 16:26:36 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:36 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9" returned: 0 in 0.377s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:36 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9 Sep 25 16:26:36 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:36 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1773afe9-38b5-4a99-a466-4ec5ad9a17d9" returned: 0 in 0.262s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-1773afe9-38b5-4a99-a466-4ec5ad9a17d9" released by "delete_volume" :: held 0.682s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created reservations ['1b0e9658-865c-4cdb-b1ac-e6a8d2c25ff1', '20f665eb-0947-4ec4-afae-f0cbebcaee90', 'dc35ede6-1df3-4d0b-b558-1b17b252d6d8', '092e7d11-6ad1-44a4-a44f-fba1d8c075d0'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:36 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:36 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:37 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.273s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Deleted volume successfully. Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3f41f1ff-8200-49b8-92fb-0cae969afb58 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-1773afe9-38b5-4a99-a466-4ec5ad9a17d9-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d26a9e7-9ee6-4593-971d-ddefe11de318]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:37 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 Sep 25 16:26:37 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:37 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83" returned: 0 in 0.387s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:37 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83 Sep 25 16:26:37 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:37 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83" returned: 0 in 0.269s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83" released by "delete_volume" :: held 0.705s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created reservations ['3758ee15-3c13-4855-ac21-781887933478', '663ecfb2-fa04-4054-8638-8bfcaaf66ba3', '0300d26c-281e-4a43-b623-7f275997926f', '0fb10d61-7a21-4154-a158-ad8dce8ce643'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:38 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:38 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:38 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-23875e9e-b9b3-496d-bfb3-fb8726d0cb11-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.304s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:38 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Deleted volume successfully. Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-23875e9e-b9b3-496d-bfb3-fb8726d0cb11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c6698245-cf39-4e0f-baa7-e4f5ac69d558 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-4dc3abfc-7cba-4551-abd5-86e2ba6b3d83-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-23875e9e-b9b3-496d-bfb3-fb8726d0cb11" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-23875e9e-b9b3-496d-bfb3-fb8726d0cb11" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Deleting offline snapshot 23875e9e-b9b3-496d-bfb3-fb8726d0cb11 of volume 4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] snapshot_file for this snap is: volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd649ec-e1e8-41df-b5c8-53af89b22f30]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:38 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 Sep 25 16:26:38 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:38 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11" returned: 0 in 0.378s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd3aad7-7b17-4062-bfd4-a626ad75cbbc]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:39 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 Sep 25 16:26:39 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:39 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" returned: 0 in 0.411s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:39 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 Sep 25 16:26:39 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:39 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11" returned: 0 in 0.380s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:39 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11 Sep 25 16:26:39 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:40 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3.23875e9e-b9b3-496d-bfb3-fb8726d0cb11" returned: 0 in 0.272s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-23875e9e-b9b3-496d-bfb3-fb8726d0cb11" released by "_delete_snapshot" :: held 1.567s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" released by "delete_snapshot" :: held 1.593s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created reservations ['bb2184ef-5abc-4c26-ac2b-395a56414ca7', '21203063-60ca-4d2e-a55b-8c177cd9555e', 'd5e1a733-4948-4e89-8023-96ec83b4e469', '1d89a3b5-1255-4ce1-89cd-99c753e72361'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:40 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Delete snapshot completed successfully. Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-98796227-522f-40e9-a8f1-615d1c1ee9f3 tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-23875e9e-b9b3-496d-bfb3-fb8726d0cb11-delete_snapshot" released by "delete_snapshot" :: held 1.771s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "cinder-quobyte-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[410059ae-c43c-487d-b46d-a75359915976]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:40 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 Sep 25 16:26:40 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:41 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" returned: 0 in 0.401s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:41 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3 Sep 25 16:26:41 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:41 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" returned: 0 in 0.247s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-quobyte-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3" released by "delete_volume" :: held 0.719s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Created reservations ['6d3eab43-12cf-4558-b62f-4ba47da269fa', '765d7c0c-4d2d-4e01-b296-f7f49d49d830', 'f36c0ce9-e748-407b-8660-91d5200fc83a', '24ba9308-a45c-4bc8-8e6e-8fe26058259b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:41 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:41 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:41 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.266s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Deleted volume successfully. Sep 25 16:26:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-e832c290-3250-4280-9998-f41b8b43cc0d tempest-CreateVolumesFromSnapshotTest-1566092728 None] Lock "cinder-4efc8cf0-09ba-46de-955c-cdf5d0a59bd3-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (2e6242e5-ce6a-4627-b104-133ae6654358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af10c9a2-02c4-412e-b6d8-dc0a95559c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af10c9a2-02c4-412e-b6d8-dc0a95559c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909759801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925e9f29-81ca-4d48-8025-8dbbf7d53272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:45Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c787e660-6daa-4beb-a77e-7692917ffe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c787e660-6daa-4beb-a77e-7692917ffe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853801f0-1bbb-4e01-bcb8-c6e456486fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853801f0-1bbb-4e01-bcb8-c6e456486fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925e9f29-81ca-4d48-8025-8dbbf7d53272', 'volume_name': 'volume-925e9f29-81ca-4d48-8025-8dbbf7d53272', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56b0a79-0fc2-4706-94a9-5bcabec82a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56b0a79-0fc2-4706-94a9-5bcabec82a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749c3f4b-d341-4f11-ae6f-6fc91eb3c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:45 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume 925e9f29-81ca-4d48-8025-8dbbf7d53272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925e9f29-81ca-4d48-8025-8dbbf7d53272', 'volume_size': 1} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909759801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925e9f29-81ca-4d48-8025-8dbbf7d53272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:45Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Creating volume 925e9f29-81ca-4d48-8025-8dbbf7d53272 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:45 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:45 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 1073741824 Sep 25 16:26:45 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:45 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 1073741824" returned: 0 in 0.493s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:45 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 Sep 25 16:26:45 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:45 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272" returned: 0 in 0.280s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749c3f4b-d341-4f11-ae6f-6fc91eb3c282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925e9f29-81ca-4d48-8025-8dbbf7d53272', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:45 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e3594b-7a5c-47dc-84b2-102a972d3875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:46 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 (925e9f29-81ca-4d48-8025-8dbbf7d53272): created successfully Sep 25 16:26:46 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e3594b-7a5c-47dc-84b2-102a972d3875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:46 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (2e6242e5-ce6a-4627-b104-133ae6654358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6534a1f9-0cc1-4c39-ad98-7ea5939629fa tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created volume successfully. Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (3f064611-ca9b-4345-820e-73d4dc5769e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88203752-d91d-4827-af79-de01826eaad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88203752-d91d-4827-af79-de01826eaad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445021277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e890673e-241a-4554-9af9-1f550ae89df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:48Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b724ba4-3ba0-43c6-9988-74b3f42d30b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b724ba4-3ba0-43c6-9988-74b3f42d30b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca73f4e7-adb4-4bfb-be94-86375e9f6b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca73f4e7-adb4-4bfb-be94-86375e9f6b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e890673e-241a-4554-9af9-1f550ae89df9', 'volume_name': 'volume-e890673e-241a-4554-9af9-1f550ae89df9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23ada09-d0ad-4809-bb92-e51b0fca7af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23ada09-d0ad-4809-bb92-e51b0fca7af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2096296f-70b6-4cc8-91f1-8d655eb568ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:47 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume e890673e-241a-4554-9af9-1f550ae89df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e890673e-241a-4554-9af9-1f550ae89df9', 'volume_size': 1} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445021277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e890673e-241a-4554-9af9-1f550ae89df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:48Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Creating volume e890673e-241a-4554-9af9-1f550ae89df9 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:47 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:47 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 1073741824 Sep 25 16:26:47 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (9a532531-59f1-46a7-99be-f33cf8cf92a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbe86be-72ef-47b9-928d-0605fd1d9faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbe86be-72ef-47b9-928d-0605fd1d9faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-608977972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:48Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc20334-df93-4b96-a891-8158f563cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc20334-df93-4b96-a891-8158f563cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b838c9f-ef76-4fcd-9fd1-923ead1c44af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b838c9f-ef76-4fcd-9fd1-923ead1c44af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3', 'volume_name': 'volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcc9d57-c4e7-4b20-9183-849527a60a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcc9d57-c4e7-4b20-9183-849527a60a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1cf697-f60e-4e47-83fc-adb8ebdff3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume 99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3', 'volume_size': 1} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:48 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 1073741824" returned: 0 in 0.579s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:48 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 Sep 25 16:26:48 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (5f565f29-8d6a-4ba2-a533-8c54199a671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e59a1f8-7525-4619-ad35-3adb85528ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e59a1f8-7525-4619-ad35-3adb85528ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776970933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7dd60c9-f60a-497c-a301-b308b75f284c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:48Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63135dc-1fb9-41f3-a2c2-d006357afdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63135dc-1fb9-41f3-a2c2-d006357afdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c30412-9253-460a-8708-11bd6ae88509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c30412-9253-460a-8708-11bd6ae88509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7dd60c9-f60a-497c-a301-b308b75f284c', 'volume_name': 'volume-c7dd60c9-f60a-497c-a301-b308b75f284c', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2019b0-d472-4c9d-a058-3c1059b52e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2019b0-d472-4c9d-a058-3c1059b52e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb94de1-c405-4805-abb2-7f3556f4d5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume c7dd60c9-f60a-497c-a301-b308b75f284c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7dd60c9-f60a-497c-a301-b308b75f284c', 'volume_size': 1} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:48 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-608977972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:48Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Creating volume 99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:48 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2096296f-70b6-4cc8-91f1-8d655eb568ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e890673e-241a-4554-9af9-1f550ae89df9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 1073741824 Sep 25 16:26:48 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a247ebef-1c60-493e-a971-87d3d7ea33af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume volume-e890673e-241a-4554-9af9-1f550ae89df9 (e890673e-241a-4554-9af9-1f550ae89df9): created successfully Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a247ebef-1c60-493e-a971-87d3d7ea33af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (3f064611-ca9b-4345-820e-73d4dc5769e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:48 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c28c9014-38b7-4a84-89ed-250f19869ac1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created volume successfully. Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (f8328b4c-45db-4585-9ed8-affb0a56b82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e05f98-6365-4c48-8d31-a8fb1262ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e05f98-6365-4c48-8d31-a8fb1262ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1994494600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bf891a-2159-4933-929d-a7f423d2a65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:49Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2f9731-20f4-4a3e-ba13-5d052f170a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2f9731-20f4-4a3e-ba13-5d052f170a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863be4dd-a334-4eda-a037-72bfcd7f6ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863be4dd-a334-4eda-a037-72bfcd7f6ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14bf891a-2159-4933-929d-a7f423d2a65d', 'volume_name': 'volume-14bf891a-2159-4933-929d-a7f423d2a65d', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2112a3d3-43c0-4ac0-b156-78d95772272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2112a3d3-43c0-4ac0-b156-78d95772272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b1309-7e08-4be5-b8f7-d1603d47fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume 14bf891a-2159-4933-929d-a7f423d2a65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14bf891a-2159-4933-929d-a7f423d2a65d', 'volume_size': 1} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:49 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 1073741824" returned: 0 in 0.567s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:49 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 Sep 25 16:26:49 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (fae4991d-4f48-432a-970f-945fa56a8a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134112aa-8dab-432c-a277-e657f755c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134112aa-8dab-432c-a277-e657f755c842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1304045348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:50Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c836008-33b5-481a-b91f-40f2307f5650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c836008-33b5-481a-b91f-40f2307f5650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6f64ba-3951-4056-b13c-5dd5a2d0c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6f64ba-3951-4056-b13c-5dd5a2d0c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0', 'volume_name': 'volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69126e6-b466-4021-9c6b-ce96d17a2904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69126e6-b466-4021-9c6b-ce96d17a2904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0599ebd2-e970-4ebc-9fbd-3eb57d3d4da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0', 'volume_size': 1} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:49 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3" returned: 0 in 0.274s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776970933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7dd60c9-f60a-497c-a301-b308b75f284c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:48Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Creating volume c7dd60c9-f60a-497c-a301-b308b75f284c {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:49 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:49 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c 1073741824 Sep 25 16:26:49 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1cf697-f60e-4e47-83fc-adb8ebdff3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a6fd5-a645-45b4-b591-7087a3825f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 (99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3): created successfully Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a6fd5-a645-45b4-b591-7087a3825f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (9a532531-59f1-46a7-99be-f33cf8cf92a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1ee85119-5831-4060-a39e-0dab083fff37 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created volume successfully. Sep 25 16:26:50 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c 1073741824" returned: 0 in 0.435s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:50 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c Sep 25 16:26:50 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:50 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c" returned: 0 in 0.250s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1994494600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bf891a-2159-4933-929d-a7f423d2a65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:49Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Creating volume 14bf891a-2159-4933-929d-a7f423d2a65d {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb94de1-c405-4805-abb2-7f3556f4d5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7dd60c9-f60a-497c-a301-b308b75f284c', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:50 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d 1073741824 Sep 25 16:26:50 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b777016b-764d-45d1-8307-23a554fb78c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume volume-c7dd60c9-f60a-497c-a301-b308b75f284c (c7dd60c9-f60a-497c-a301-b308b75f284c): created successfully Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b777016b-764d-45d1-8307-23a554fb78c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (5f565f29-8d6a-4ba2-a533-8c54199a671f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:50 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e69de64a-a4d1-4f6c-8f09-8477148e5979 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created volume successfully. Sep 25 16:26:50 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d 1073741824" returned: 0 in 0.494s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d Sep 25 16:26:51 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:51 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d" returned: 0 in 0.260s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1304045348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4b6e9bc4084786988db0e2cf19e3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:26:50Z,use_quota=True,user_id='15aa3665aca14bd7ab5f39c70dc9ac1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Creating volume b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:26:51 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b1309-7e08-4be5-b8f7-d1603d47fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14bf891a-2159-4933-929d-a7f423d2a65d', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:51 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 1073741824 Sep 25 16:26:51 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa08978-1761-4c2b-ae26-dc5d532d926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume volume-14bf891a-2159-4933-929d-a7f423d2a65d (14bf891a-2159-4933-929d-a7f423d2a65d): created successfully Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa08978-1761-4c2b-ae26-dc5d532d926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (f8328b4c-45db-4585-9ed8-affb0a56b82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6acf7c21-6980-464d-ada6-6b7ba4fa3883 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created volume successfully. Sep 25 16:26:51 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 1073741824" returned: 0 in 0.495s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:51 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 Sep 25 16:26:51 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:52 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0" returned: 0 in 0.265s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:26:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0599ebd2-e970-4ebc-9fbd-3eb57d3d4da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01390986-a5ec-4440-a590-d6541f8eab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:26:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Volume volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 (b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0): created successfully Sep 25 16:26:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01390986-a5ec-4440-a590-d6541f8eab39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:26:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Flow 'volume_create_manager' (fae4991d-4f48-432a-970f-945fa56a8a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:26:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7749c27a-050d-4f4c-9cb8-babe365b2ee1 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created volume successfully. Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-quobyte-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74e703d-43ac-4738-a2cb-11e3b1d1cf3a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:53 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 Sep 25 16:26:53 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:53 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0" returned: 0 in 0.416s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:53 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0 Sep 25 16:26:53 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:53 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0" returned: 0 in 0.316s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0" released by "delete_volume" :: held 0.785s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:53 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created reservations ['b4ec6300-d288-4a7f-9f7e-5e771e486740', '3e5cbe8f-f245-4d0d-94b1-e70fa9513095', 'fef31fae-2772-427e-aeed-f13baf6d79b8', '43a076c8-c074-4e04-a9b4-8bef8bce223f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:54 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-14bf891a-2159-4933-929d-a7f423d2a65d-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-14bf891a-2159-4933-929d-a7f423d2a65d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-quobyte-14bf891a-2159-4933-929d-a7f423d2a65d" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-14bf891a-2159-4933-929d-a7f423d2a65d" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:54 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.354s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[44529f68-fa39-4a73-98af-87465d931d44]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Deleted volume successfully. Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4d911c0f-4deb-469b-9601-7bb66be5b7e9 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-b0d0f79f-e4c4-47c3-9dfb-1bf0ec497ed0-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:54 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d Sep 25 16:26:54 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:54 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d" returned: 0 in 0.442s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:54 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d Sep 25 16:26:54 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:55 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-14bf891a-2159-4933-929d-a7f423d2a65d" returned: 0 in 0.271s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-14bf891a-2159-4933-929d-a7f423d2a65d" released by "delete_volume" :: held 0.798s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created reservations ['b8eb67b0-9e5a-48d4-a92a-975b1662a19f', '9b59939f-4765-437c-a46e-c2ff488383e4', 'ee577338-70ca-411a-8d9b-b37be58dbec9', '75b4de8e-34e6-4847-a942-8822afaedec6'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:55 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:55 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-c7dd60c9-f60a-497c-a301-b308b75f284c-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-c7dd60c9-f60a-497c-a301-b308b75f284c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-quobyte-c7dd60c9-f60a-497c-a301-b308b75f284c" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-c7dd60c9-f60a-497c-a301-b308b75f284c" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4d6145-9076-4d8e-97cc-5e473cd49477]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:55 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.320s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Deleted volume successfully. Sep 25 16:26:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3353fb38-cf86-4ad5-98e9-d308306de65d tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-14bf891a-2159-4933-929d-a7f423d2a65d-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:55 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c Sep 25 16:26:55 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:56 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c" returned: 0 in 0.427s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c Sep 25 16:26:56 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:56 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c7dd60c9-f60a-497c-a301-b308b75f284c" returned: 0 in 0.258s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-c7dd60c9-f60a-497c-a301-b308b75f284c" released by "delete_volume" :: held 0.742s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created reservations ['a49ad56a-6f3f-4e86-bb8f-49d88cea492f', '413968ac-e90a-4a71-8548-829c705b2d01', '8db0958f-4c56-4b88-bbe2-61ce9c064b9b', 'c2dc3d27-76c3-44e9-9446-45a49cfe7b08'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:56 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-quobyte-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:56 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.329s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Deleted volume successfully. Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8916db-a23b-45fb-bf86-e8090dbbd42b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7722fc5b-c918-4aec-b559-bb9b46f2cad0 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-c7dd60c9-f60a-497c-a301-b308b75f284c-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:56 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 Sep 25 16:26:56 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3 Sep 25 16:26:57 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3" released by "delete_volume" :: held 0.778s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created reservations ['3f2dd0c2-e735-4e3f-a4d9-f02d68c3f078', '70d43922-2c8c-45c8-af3f-ccc7250e3b97', 'e7af7677-fea4-49c9-a822-3a8f3e50b321', '1adac473-0f30-489d-bb46-112d0a93f17b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:57 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:57 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-e890673e-241a-4554-9af9-1f550ae89df9-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-e890673e-241a-4554-9af9-1f550ae89df9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-quobyte-e890673e-241a-4554-9af9-1f550ae89df9" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-e890673e-241a-4554-9af9-1f550ae89df9" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa80e2d4-4ab5-4f6f-989f-df8f3a53fcf2]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:58 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.323s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Deleted volume successfully. Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-48e6d741-00f3-4f02-a890-fbd582d10f33 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-99aaa727-ca8a-4c38-8d5a-97b2ba0cbad3-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:58 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 Sep 25 16:26:58 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:58 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9" returned: 0 in 0.390s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:58 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9 Sep 25 16:26:58 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:58 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-e890673e-241a-4554-9af9-1f550ae89df9" returned: 0 in 0.287s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-e890673e-241a-4554-9af9-1f550ae89df9" released by "delete_volume" :: held 0.724s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created reservations ['71772aaa-b6ae-4546-923b-a2f24615b518', 'afdc4648-28c9-40dd-a3fd-f06b2d462901', '8a28433f-93e1-46d8-9991-9156cd9c02f1', '6e65fed1-d465-4ab6-b25f-e093ae22eb95'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:26:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:58 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:26:58 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-925e9f29-81ca-4d48-8025-8dbbf7d53272-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-925e9f29-81ca-4d48-8025-8dbbf7d53272-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:59 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.287s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "cinder-quobyte-925e9f29-81ca-4d48-8025-8dbbf7d53272" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:26:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Deleted volume successfully. Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-925e9f29-81ca-4d48-8025-8dbbf7d53272" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6cfe0ad3-46f6-47cb-95cd-e633c8b83a7f tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-e890673e-241a-4554-9af9-1f550ae89df9-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[04db49c3-5a33-4a12-bc26-78bdd91d4f5f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:59 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 Sep 25 16:26:59 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:59 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272" returned: 0 in 0.406s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:26:59 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272 Sep 25 16:26:59 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:26:59 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-925e9f29-81ca-4d48-8025-8dbbf7d53272" returned: 0 in 0.249s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-quobyte-925e9f29-81ca-4d48-8025-8dbbf7d53272" released by "delete_volume" :: held 0.702s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Created reservations ['d9a74905-41c1-4874-9c6b-16dfe80ff58a', '59ec2ccb-6fbc-4ae7-9b4b-379114b03bbe', 'ffc74993-ea60-4ad4-8377-5d767706d3c4', '20c4db52-87f4-4de7-ad59-811fea36a6a0'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:26:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:00 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:27:00 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:00 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.279s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:00 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Deleted volume successfully. Sep 25 16:27:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-13150043-cd33-4948-95e8-5c358ee0c337 tempest-CreateVolumesFromSourceVolumeTest-1421275940 None] Lock "cinder-925e9f29-81ca-4d48-8025-8dbbf7d53272-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=162,cinder:SELECT=104,cinder:INSERT=44,cinder:DELETE=15 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:05 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=109,cinder:UPDATE=142,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Flow 'volume_create_manager' (bff0273e-bb05-4095-a715-0264a1af5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ceb0ec-db9f-4120-a964-ffdcfa9f864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ceb0ec-db9f-4120-a964-ffdcfa9f864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1b9bb3-41fd-4112-9c8e-1650cd97f489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34431598bd37467b943784ab78bb0c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:06Z,use_quota=True,user_id='385c555436df4f1daf8673db1678e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29d4d22-932c-424b-833e-ee773ea3497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29d4d22-932c-424b-833e-ee773ea3497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30755cdf-901a-42fb-857c-12cd60145aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30755cdf-901a-42fb-857c-12cd60145aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b1b9bb3-41fd-4112-9c8e-1650cd97f489', 'volume_name': 'volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489', 'volume_size': 1, 'image_id': '98094e17-0c89-4978-af12-21c19cde6994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98094e17-0c89-4978-af12-21c19cde6994', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a77f6d33e0d058c4a7d508aa1b869d4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34431598bd37467b943784ab78bb0c1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f26eff80e8c9cb391cad445fa2a64187ea8cbb3b63826cac3b022370b29558dd8c1177608bffb51d00dd83eff76a5ab795d5429540a1f7f351e7beec4bd089fb', 'id': '98094e17-0c89-4978-af12-21c19cde6994', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98094e17-0c89-4978-af12-21c19cde6994/file', 'properties': {}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09554ea3-a6af-4bb5-9205-a06df6ffec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09554ea3-a6af-4bb5-9205-a06df6ffec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fcc878-da56-4849-b143-50892d09d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:06 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Volume 0b1b9bb3-41fd-4112-9c8e-1650cd97f489: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489', 'volume_size': 1, 'image_id': '98094e17-0c89-4978-af12-21c19cde6994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98094e17-0c89-4978-af12-21c19cde6994', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a77f6d33e0d058c4a7d508aa1b869d4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34431598bd37467b943784ab78bb0c1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f26eff80e8c9cb391cad445fa2a64187ea8cbb3b63826cac3b022370b29558dd8c1177608bffb51d00dd83eff76a5ab795d5429540a1f7f351e7beec4bd089fb', 'id': '98094e17-0c89-4978-af12-21c19cde6994', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98094e17-0c89-4978-af12-21c19cde6994/file', 'properties': {}}, 'image_service': } Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Trying to clone 0b1b9bb3-41fd-4112-9c8e-1650cd97f489 from image 98094e17-0c89-4978-af12-21c19cde6994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/98094e17-0c89-4978-af12-21c19cde6994', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:27:06 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[61939a92-6e31-458a-a1e0-34f3e73dca65]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:06 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD Sep 25 16:27:06 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:06 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:06 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD Sep 25 16:27:06 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:07 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:07 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Temporary image 98094e17-0c89-4978-af12-21c19cde6994 is fetched for user 385c555436df4f1daf8673db1678e160. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:27:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df1bc20-472c-43fc-998d-6708d9cd625b]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:07 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD Sep 25 16:27:07 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:07 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:07 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD Sep 25 16:27:07 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:08 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1b9bb3-41fd-4112-9c8e-1650cd97f489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34431598bd37467b943784ab78bb0c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:06Z,use_quota=True,user_id='385c555436df4f1daf8673db1678e160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Creating volume 0b1b9bb3-41fd-4112-9c8e-1650cd97f489 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:08 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:08 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 1073741824 Sep 25 16:27:08 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:08 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 1073741824" returned: 0 in 0.465s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:08 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 Sep 25 16:27:08 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:08 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489" returned: 0 in 0.281s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Attempting download of 98094e17-0c89-4978-af12-21c19cde6994 ((None, [{'url': 'file:///opt/stack/data/glance/images/98094e17-0c89-4978-af12-21c19cde6994', 'metadata': {}}])) to volume 0b1b9bb3-41fd-4112-9c8e-1650cd97f489. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a881fde-d52c-4321-bdf2-853432cb3102]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98094e17-0c89-4978-af12-21c19cde6994__nqlua68 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:09 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98094e17-0c89-4978-af12-21c19cde6994__nqlua68 Sep 25 16:27:09 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:09 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98094e17-0c89-4978-af12-21c19cde6994__nqlua68" returned: 0 in 0.362s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98094e17-0c89-4978-af12-21c19cde6994__nqlua68 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:09 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98094e17-0c89-4978-af12-21c19cde6994__nqlua68 Sep 25 16:27:09 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:09 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98094e17-0c89-4978-af12-21c19cde6994__nqlua68" returned: 1 in 0.351s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98094e17-0c89-4978-af12-21c19cde6994__nqlua68' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:09 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[422db81c-2579-4ecd-b4af-61a1d6c44934]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:09 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD Sep 25 16:27:09 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:10 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:10 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD Sep 25 16:27:10 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:10 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] 98094e17-0c89-4978-af12-21c19cde6994 was raw, converting to qcow2 {{(pid=87467) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:10 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 Sep 25 16:27:10 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:10 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489" returned: 0 in 0.478s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_98094e17-0c89-4978-af12-21c19cde6994_hc_nbr77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:27:10 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:27:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:10 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 1G Sep 25 16:27:10 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:11 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 1G" returned: 0 in 0.333s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Downloaded image 98094e17-0c89-4978-af12-21c19cde6994 ((None, [{'url': 'file:///opt/stack/data/glance/images/98094e17-0c89-4978-af12-21c19cde6994', 'metadata': {}}])) to volume 0b1b9bb3-41fd-4112-9c8e-1650cd97f489 successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Temporary image 98094e17-0c89-4978-af12-21c19cde6994 for user 385c555436df4f1daf8673db1678e160 is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Marking volume 0b1b9bb3-41fd-4112-9c8e-1650cd97f489 as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Copying metadata from image 98094e17-0c89-4978-af12-21c19cde6994 to 0b1b9bb3-41fd-4112-9c8e-1650cd97f489. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Creating volume glance metadata for volume 0b1b9bb3-41fd-4112-9c8e-1650cd97f489 backed by image 98094e17-0c89-4978-af12-21c19cde6994 with: {'image_id': '98094e17-0c89-4978-af12-21c19cde6994', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0a77f6d33e0d058c4a7d508aa1b869d4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fcc878-da56-4849-b143-50892d09d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489', 'volume_size': 1, 'image_id': '98094e17-0c89-4978-af12-21c19cde6994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98094e17-0c89-4978-af12-21c19cde6994', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a77f6d33e0d058c4a7d508aa1b869d4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34431598bd37467b943784ab78bb0c1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f26eff80e8c9cb391cad445fa2a64187ea8cbb3b63826cac3b022370b29558dd8c1177608bffb51d00dd83eff76a5ab795d5429540a1f7f351e7beec4bd089fb', 'id': '98094e17-0c89-4978-af12-21c19cde6994', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98094e17-0c89-4978-af12-21c19cde6994/file', 'properties': {}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d13ccb8-7172-415c-8390-068b31cde0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:11 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Volume volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 (0b1b9bb3-41fd-4112-9c8e-1650cd97f489): created successfully Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d13ccb8-7172-415c-8390-068b31cde0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:11 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Flow 'volume_create_manager' (bff0273e-bb05-4095-a715-0264a1af5d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ee572a58-89b9-46e0-ab77-d63b4f7e17dd tempest-VolumeImageDependencyTests-2128415560 None] Created volume successfully. Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Acquiring lock "cinder-0b1b9bb3-41fd-4112-9c8e-1650cd97f489-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Lock "cinder-0b1b9bb3-41fd-4112-9c8e-1650cd97f489-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Acquiring lock "cinder-quobyte-0b1b9bb3-41fd-4112-9c8e-1650cd97f489" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Lock "cinder-quobyte-0b1b9bb3-41fd-4112-9c8e-1650cd97f489" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2882d715-ff23-4d0f-9ba9-f8d687cef136]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:12 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 Sep 25 16:27:12 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:12 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489" returned: 0 in 0.379s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:12 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489 Sep 25 16:27:12 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:13 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-0b1b9bb3-41fd-4112-9c8e-1650cd97f489" returned: 0 in 0.265s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Lock "cinder-quobyte-0b1b9bb3-41fd-4112-9c8e-1650cd97f489" released by "delete_volume" :: held 0.691s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Created reservations ['e926a8c2-33cc-42cf-9071-1514adbfd18e', '62086ddc-8422-41c0-acd9-7a99b1a6dc6c', '781bf648-01f3-4fa7-bcbf-cebe648716f3', 'a7c769b2-149e-4df2-88cf-38a3fba8ee48'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:13 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:27:13 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:13 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.289s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:13 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Deleted volume successfully. Sep 25 16:27:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77e95e2f-dacc-4969-8f30-fc16cc59718b tempest-VolumeImageDependencyTests-2128415560 None] Lock "cinder-0b1b9bb3-41fd-4112-9c8e-1650cd97f489-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:15 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:27:15 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:15 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.282s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:27:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Flow 'volume_create_manager' (9611189d-8c39-4c92-838c-deea1db44195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd41b7e-dbb7-4bd9-afc5-9441916780bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd41b7e-dbb7-4bd9-afc5-9441916780bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330bccc-3698-412a-ad81-8bf8b69db07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab58bcdddd0447ce805e9900b3c8c041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:17Z,use_quota=True,user_id='61c02fca16dc41b7b27db94225825a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b41cba-dc9a-4c3e-b0fc-62bf4226755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b41cba-dc9a-4c3e-b0fc-62bf4226755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c02171-98a4-4151-b548-1f9789fa98f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c02171-98a4-4151-b548-1f9789fa98f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4330bccc-3698-412a-ad81-8bf8b69db07f', 'volume_name': 'volume-4330bccc-3698-412a-ad81-8bf8b69db07f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378269f0-5f4a-4d78-bed5-c763d8e9db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378269f0-5f4a-4d78-bed5-c763d8e9db82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7776c647-f469-4e3c-a544-211e5852f922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Volume 4330bccc-3698-412a-ad81-8bf8b69db07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4330bccc-3698-412a-ad81-8bf8b69db07f', 'volume_size': 1} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330bccc-3698-412a-ad81-8bf8b69db07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab58bcdddd0447ce805e9900b3c8c041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:17Z,use_quota=True,user_id='61c02fca16dc41b7b27db94225825a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Creating volume 4330bccc-3698-412a-ad81-8bf8b69db07f {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:17 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f 1073741824 Sep 25 16:27:17 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f 1073741824" returned: 0 in 0.494s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:17 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f Sep 25 16:27:17 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:17 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f" returned: 0 in 0.258s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7776c647-f469-4e3c-a544-211e5852f922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4330bccc-3698-412a-ad81-8bf8b69db07f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282ca9dc-2d18-4fca-b859-6435d5441b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Volume volume-4330bccc-3698-412a-ad81-8bf8b69db07f (4330bccc-3698-412a-ad81-8bf8b69db07f): created successfully Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282ca9dc-2d18-4fca-b859-6435d5441b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Flow 'volume_create_manager' (9611189d-8c39-4c92-838c-deea1db44195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3ee08842-1af7-421e-8991-698e8dc32032 tempest-CinderUnicodeTest-1018510197 None] Created volume successfully. Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Flow 'volume_create_manager' (5a8e42f9-2395-4f0d-8d76-443d443eda8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d057a85-0bec-49ca-8488-2ccd5edad293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d057a85-0bec-49ca-8488-2ccd5edad293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1614033969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1317da47-b4f1-4a2b-a98b-2790ac870602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab58bcdddd0447ce805e9900b3c8c041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:20Z,use_quota=True,user_id='61c02fca16dc41b7b27db94225825a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c1b895-4500-4fda-b4e1-a5f3c61add3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c1b895-4500-4fda-b4e1-a5f3c61add3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628880c5-ba80-498c-8046-526c0632688d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628880c5-ba80-498c-8046-526c0632688d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1317da47-b4f1-4a2b-a98b-2790ac870602', 'volume_name': 'volume-1317da47-b4f1-4a2b-a98b-2790ac870602', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2068bfb3-ce59-4917-9486-b58a1f8a58b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2068bfb3-ce59-4917-9486-b58a1f8a58b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218bc4cf-2251-46e0-9074-30462c0d88da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:19 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Volume 1317da47-b4f1-4a2b-a98b-2790ac870602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1317da47-b4f1-4a2b-a98b-2790ac870602', 'volume_size': 1} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1614033969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1317da47-b4f1-4a2b-a98b-2790ac870602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab58bcdddd0447ce805e9900b3c8c041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:20Z,use_quota=True,user_id='61c02fca16dc41b7b27db94225825a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Creating volume 1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:19 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:19 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 1073741824 Sep 25 16:27:19 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 1073741824" returned: 0 in 0.470s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:20 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 Sep 25 16:27:20 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:20 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602" returned: 0 in 0.292s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218bc4cf-2251-46e0-9074-30462c0d88da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1317da47-b4f1-4a2b-a98b-2790ac870602', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b7bb09-2737-434b-ba76-d76a3d4830c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Volume volume-1317da47-b4f1-4a2b-a98b-2790ac870602 (1317da47-b4f1-4a2b-a98b-2790ac870602): created successfully Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b7bb09-2737-434b-ba76-d76a3d4830c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Flow 'volume_create_manager' (5a8e42f9-2395-4f0d-8d76-443d443eda8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ba469211-e220-48bf-8b67-67a8be7f4307 tempest-CinderUnicodeTest-1018510197 None] Created volume successfully. Sep 25 16:27:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Creating offline snapshot f79f6149-85d3-4802-ac35-0202cd3d267d of volume 1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:27:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[55384a1f-4dd6-46f2-926c-1eb845ec2093]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:22 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 Sep 25 16:27:22 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:22 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602" returned: 0 in 0.466s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:22 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d 1G Sep 25 16:27:22 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:23 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d 1G" returned: 0 in 0.512s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1317da47-b4f1-4a2b-a98b-2790ac870602 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:23 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1317da47-b4f1-4a2b-a98b-2790ac870602 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d Sep 25 16:27:23 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:23 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1317da47-b4f1-4a2b-a98b-2790ac870602 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d" returned: 0 in 0.355s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:23 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d is being set with open permissions: ugo+rw Sep 25 16:27:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:23 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d Sep 25 16:27:23 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:23 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d" returned: 0 in 0.295s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:23 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.info Sep 25 16:27:23 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:24 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.info" returned: 0 in 0.329s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:24 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.info is being set with open permissions: ugo+rw Sep 25 16:27:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:24 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.info Sep 25 16:27:24 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:24 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.info" returned: 0 in 0.292s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:24 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c984f3c6-81a6-41be-b32a-9fd73c7e4ad4 tempest-CinderUnicodeTest-1018510197 None] Create snapshot completed successfully Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "cinder-f79f6149-85d3-4802-ac35-0202cd3d267d-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-f79f6149-85d3-4802-ac35-0202cd3d267d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "cinder-quobyte-1317da47-b4f1-4a2b-a98b-2790ac870602" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-1317da47-b4f1-4a2b-a98b-2790ac870602" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "cinder-quobyte-f79f6149-85d3-4802-ac35-0202cd3d267d" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-f79f6149-85d3-4802-ac35-0202cd3d267d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Deleting offline snapshot f79f6149-85d3-4802-ac35-0202cd3d267d of volume 1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] snapshot_file for this snap is: volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5c05a3-3b70-48ca-b4d7-2f9c0f48fad6]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:25 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d Sep 25 16:27:25 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:25 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d" returned: 0 in 0.431s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1317da47-b4f1-4a2b-a98b-2790ac870602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f334b94-3c0c-4ab6-84f6-ce9169c721a4]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:26 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 Sep 25 16:27:26 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:26 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602" returned: 0 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:26 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d Sep 25 16:27:26 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:26 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d" returned: 0 in 0.381s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:26 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d Sep 25 16:27:26 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:27 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602.f79f6149-85d3-4802-ac35-0202cd3d267d" returned: 0 in 0.287s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-f79f6149-85d3-4802-ac35-0202cd3d267d" released by "_delete_snapshot" :: held 1.659s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-1317da47-b4f1-4a2b-a98b-2790ac870602" released by "delete_snapshot" :: held 1.686s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Created reservations ['2a1c1d43-7dd8-4296-b81b-cc66a92e2fba', '247624bc-1e4d-4e8e-b6d0-6d7ab534b5c3', '8d91d1e1-7ae2-4e6a-a94c-5794a3e5fdc1', '727183d0-1e54-4e41-a309-4b418e0b1ceb'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:27 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Delete snapshot completed successfully. Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4f3f9590-0dd1-4ff8-a007-a608fbcd1d9d tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-f79f6149-85d3-4802-ac35-0202cd3d267d-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "cinder-1317da47-b4f1-4a2b-a98b-2790ac870602-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-1317da47-b4f1-4a2b-a98b-2790ac870602-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "cinder-quobyte-1317da47-b4f1-4a2b-a98b-2790ac870602" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-1317da47-b4f1-4a2b-a98b-2790ac870602" acquired by "delete_volume" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c00b0-1ce2-42d2-a5c2-0c522c0ed747]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:27 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 Sep 25 16:27:27 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:28 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602" returned: 0 in 0.405s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:28 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602 Sep 25 16:27:28 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:28 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317da47-b4f1-4a2b-a98b-2790ac870602" returned: 0 in 0.293s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-1317da47-b4f1-4a2b-a98b-2790ac870602" released by "delete_volume" :: held 0.770s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Created reservations ['c360fe72-988e-4b24-9616-e1ee8acd1dc9', '49515f5b-c290-4a0b-b4b5-34e07dd3b54f', 'c9e5ef37-5f6c-4299-8689-c05eae7ac3e5', '9589e60b-4318-4504-8271-5c205890d4be'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:28 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:27:28 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "cinder-4330bccc-3698-412a-ad81-8bf8b69db07f-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-4330bccc-3698-412a-ad81-8bf8b69db07f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "cinder-quobyte-4330bccc-3698-412a-ad81-8bf8b69db07f" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:28 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-4330bccc-3698-412a-ad81-8bf8b69db07f" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.333s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Deleted volume successfully. Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[013ccbf3-c532-46a0-8600-e17a71664bc1]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-824f9673-683f-460b-983c-fd7680af7a74 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-1317da47-b4f1-4a2b-a98b-2790ac870602-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:28 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f Sep 25 16:27:28 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:29 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f" returned: 0 in 0.414s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:29 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f Sep 25 16:27:29 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:29 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-4330bccc-3698-412a-ad81-8bf8b69db07f" returned: 0 in 0.292s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-quobyte-4330bccc-3698-412a-ad81-8bf8b69db07f" released by "delete_volume" :: held 0.769s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Created reservations ['fffa9b8c-4274-4c0d-a99b-1bb52ec79603', 'e8b264ae-c582-4547-8f46-b24352120a15', '14902762-8ede-4858-9f83-3669581ea641', '4fd710f5-1031-48c8-ba46-8c83f1da6843'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:29 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:27:29 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:30 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.311s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:30 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Deleted volume successfully. Sep 25 16:27:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-a839784c-2d54-4ad6-9134-4ad32b09ed42 tempest-CinderUnicodeTest-1018510197 None] Lock "cinder-4330bccc-3698-412a-ad81-8bf8b69db07f-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=37,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=34,cinder:INSERT=17,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:27:49 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (f8872568-5007-47ce-8a31-d957cd4ac68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b70ad50-c1a4-4745-862f-585892f471d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b70ad50-c1a4-4745-862f-585892f471d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-137437503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:50Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7badad5b-914a-495b-851f-16a7609fb50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7badad5b-914a-495b-851f-16a7609fb50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e302f62-1d60-4141-b033-9f46fa706e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e302f62-1d60-4141-b033-9f46fa706e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76a4323-d8c5-4b70-bb1c-9c71ed42ac5a', 'volume_name': 'volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cb46d6-2589-422e-9a0d-806bbaae16b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cb46d6-2589-422e-9a0d-806bbaae16b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e5694c-3069-4692-a203-88a7378607c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Volume d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a', 'volume_size': 1} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-137437503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:50Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Creating volume d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:50 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a 1073741824 Sep 25 16:27:50 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (5d8102d8-1a00-48b1-9ed1-0e1458a91453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adebd8c-a768-4b1a-8b9d-d48373354f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9adebd8c-a768-4b1a-8b9d-d48373354f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1844862384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa265c0c-15a4-4feb-9ec3-8c3108a7a972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:50Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6159edc5-1c2e-4b61-a327-0c0d607875de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6159edc5-1c2e-4b61-a327-0c0d607875de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49142984-83d1-4430-a73d-a049b61a0e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49142984-83d1-4430-a73d-a049b61a0e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa265c0c-15a4-4feb-9ec3-8c3108a7a972', 'volume_name': 'volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60d857a-101e-4b2a-9375-e55e9a09d969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60d857a-101e-4b2a-9375-e55e9a09d969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04718360-bb54-4b1b-a9f6-7aa1db973746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Volume aa265c0c-15a4-4feb-9ec3-8c3108a7a972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972', 'volume_size': 1} Sep 25 16:27:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:51 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a 1073741824" returned: 0 in 0.997s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:51 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a Sep 25 16:27:51 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (8fb4528e-5277-4699-bb70-72c673d3f298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1c6e82-f5e3-4fa0-8d79-d64227b4938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1c6e82-f5e3-4fa0-8d79-d64227b4938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-11424819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2830e5b-f97d-42d7-bae0-a948a59df86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:51Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e7c7f5-d873-467f-a558-26e35b1e09f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e7c7f5-d873-467f-a558-26e35b1e09f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8915c0-df24-4c36-8d05-678fe4f5ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8915c0-df24-4c36-8d05-678fe4f5ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2830e5b-f97d-42d7-bae0-a948a59df86c', 'volume_name': 'volume-f2830e5b-f97d-42d7-bae0-a948a59df86c', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8eb7e1-65c3-4015-9c5c-687192bfd398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8eb7e1-65c3-4015-9c5c-687192bfd398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c393413-2158-4650-8ae9-f791b5963d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Volume f2830e5b-f97d-42d7-bae0-a948a59df86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2830e5b-f97d-42d7-bae0-a948a59df86c', 'volume_size': 1} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:51 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a" returned: 0 in 0.641s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.988s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1844862384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa265c0c-15a4-4feb-9ec3-8c3108a7a972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:50Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Creating volume aa265c0c-15a4-4feb-9ec3-8c3108a7a972 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:51 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e5694c-3069-4692-a203-88a7378607c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd31c9f-574e-4889-96ae-9700f80bb1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:51 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 1073741824 Sep 25 16:27:51 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Volume volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a (d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a): created successfully Sep 25 16:27:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd31c9f-574e-4889-96ae-9700f80bb1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (f8872568-5007-47ce-8a31-d957cd4ac68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c7354726-7a3f-45d1-a350-8f80fbaa2d05 tempest-CreateVolumesFromImageTest-1930951688 None] Created volume successfully. Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (35075eaf-b209-475a-a9d2-47963280a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba216f85-bcbe-4075-892d-1d2cf0598a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba216f85-bcbe-4075-892d-1d2cf0598a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667117703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc28e01d-418e-4c20-9bce-a1ea6c481a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:52Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86dc002e-3b5a-4539-a5d9-1ab3c2afc163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86dc002e-3b5a-4539-a5d9-1ab3c2afc163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92620cdd-e8ba-49ed-9c5e-45c4b5ec9268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92620cdd-e8ba-49ed-9c5e-45c4b5ec9268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc28e01d-418e-4c20-9bce-a1ea6c481a04', 'volume_name': 'volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4e6f1d-36f5-4140-9ccd-cf321a4f0aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4e6f1d-36f5-4140-9ccd-cf321a4f0aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8902b3bf-a8b7-460a-83a8-8ad313bfdb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:52 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Volume cc28e01d-418e-4c20-9bce-a1ea6c481a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04', 'volume_size': 1} Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:52 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 1073741824" returned: 0 in 1.035s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:53 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 Sep 25 16:27:53 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (1f930b90-7b6a-4317-9782-7479c52a7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20371209-6e98-4177-b805-5bf001ce21e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20371209-6e98-4177-b805-5bf001ce21e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-153999576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ac1794-b9ef-4165-ad1c-cf16e24f7120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:53Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26b27b-9846-4268-abef-9eddf24e7bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26b27b-9846-4268-abef-9eddf24e7bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893dff84-3d4f-4256-aa20-3106edb39959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893dff84-3d4f-4256-aa20-3106edb39959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ac1794-b9ef-4165-ad1c-cf16e24f7120', 'volume_name': 'volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca1ab18-d816-4b4a-87b3-3f3aadbaeb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:53 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca1ab18-d816-4b4a-87b3-3f3aadbaeb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb35b62f-d082-4034-86d6-c1f41bbe84e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Volume 26ac1794-b9ef-4165-ad1c-cf16e24f7120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120', 'volume_size': 1} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972" returned: 0 in 0.454s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.747s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-11424819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2830e5b-f97d-42d7-bae0-a948a59df86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:51Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Creating volume f2830e5b-f97d-42d7-bae0-a948a59df86c {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:53 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04718360-bb54-4b1b-a9f6-7aa1db973746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:53 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c 1073741824 Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7021d2a6-da0c-4c37-a5cf-f833daa5cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:53 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Volume volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 (aa265c0c-15a4-4feb-9ec3-8c3108a7a972): created successfully Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7021d2a6-da0c-4c37-a5cf-f833daa5cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (5d8102d8-1a00-48b1-9ed1-0e1458a91453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d41a6623-5335-43d3-9eba-0d0fdd9773b6 tempest-CreateVolumesFromImageTest-1930951688 None] Created volume successfully. Sep 25 16:27:54 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c 1073741824" returned: 0 in 0.770s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:54 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c Sep 25 16:27:54 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:54 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c" returned: 0 in 0.393s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667117703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc28e01d-418e-4c20-9bce-a1ea6c481a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:52Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Creating volume cc28e01d-418e-4c20-9bce-a1ea6c481a04 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:54 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:54 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 1073741824 Sep 25 16:27:54 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c393413-2158-4650-8ae9-f791b5963d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2830e5b-f97d-42d7-bae0-a948a59df86c', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715382dc-38a5-4223-8b57-a958f3bcf380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:54 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Volume volume-f2830e5b-f97d-42d7-bae0-a948a59df86c (f2830e5b-f97d-42d7-bae0-a948a59df86c): created successfully Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715382dc-38a5-4223-8b57-a958f3bcf380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:54 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (8fb4528e-5277-4699-bb70-72c673d3f298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-334eddaa-f578-4601-ac3b-eeef4ddc1643 tempest-CreateVolumesFromImageTest-1930951688 None] Created volume successfully. Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Flow 'volume_create_manager' (e96cdf82-d9ae-46e0-8647-7503975839c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7fecd2-ec63-4e30-a60a-6f5af9a706d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7fecd2-ec63-4e30-a60a-6f5af9a706d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f763f6-849e-4b57-aac3-f12406e68207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401609e15acc4471b12d5e8c8c58b631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:55Z,use_quota=True,user_id='37843149ce434e96b59e65d90e88e9da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eac8932-7dde-4abe-b564-7b0d37cf5ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eac8932-7dde-4abe-b564-7b0d37cf5ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726391ca-ba0f-4950-9cc3-c0427a05a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:27:55 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 1073741824" returned: 0 in 1.037s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:55 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 Sep 25 16:27:55 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726391ca-ba0f-4950-9cc3-c0427a05a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01f763f6-849e-4b57-aac3-f12406e68207', 'volume_name': 'volume-01f763f6-849e-4b57-aac3-f12406e68207', 'volume_size': 1, 'image_id': 'f3f62c01-281f-4a36-a13a-55cadcf067cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3f62c01-281f-4a36-a13a-55cadcf067cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '96b630777f6766e465d73d15467694d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '401609e15acc4471b12d5e8c8c58b631', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a53650dd31699c3b8bb72c2d3f01c459ea8478a6abb788c1f730dfd3e5f119829a0554ba9e9c5e18d376ec39e43f926bc86c49a54e2e500b869bea4fc127253', 'id': 'f3f62c01-281f-4a36-a13a-55cadcf067cf', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3f62c01-281f-4a36-a13a-55cadcf067cf/file', 'properties': {}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a3f1c8-0cf1-4276-a40d-4e8adca1c78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a3f1c8-0cf1-4276-a40d-4e8adca1c78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae906b7-e6ed-454d-b878-274d3f17103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Volume 01f763f6-849e-4b57-aac3-f12406e68207: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01f763f6-849e-4b57-aac3-f12406e68207', 'volume_size': 1, 'image_id': 'f3f62c01-281f-4a36-a13a-55cadcf067cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3f62c01-281f-4a36-a13a-55cadcf067cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '96b630777f6766e465d73d15467694d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '401609e15acc4471b12d5e8c8c58b631', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a53650dd31699c3b8bb72c2d3f01c459ea8478a6abb788c1f730dfd3e5f119829a0554ba9e9c5e18d376ec39e43f926bc86c49a54e2e500b869bea4fc127253', 'id': 'f3f62c01-281f-4a36-a13a-55cadcf067cf', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3f62c01-281f-4a36-a13a-55cadcf067cf/file', 'properties': {}}, 'image_service': } Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Trying to clone 01f763f6-849e-4b57-aac3-f12406e68207 from image f3f62c01-281f-4a36-a13a-55cadcf067cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3f62c01-281f-4a36-a13a-55cadcf067cf', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:27:56 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:27:56 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04" returned: 0 in 0.424s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.824s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-153999576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ac1794-b9ef-4165-ad1c-cf16e24f7120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc65e94cf0248f3834de653560fbff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:53Z,use_quota=True,user_id='0d5f8f864d64442c9bb323046c16119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Creating volume 26ac1794-b9ef-4165-ad1c-cf16e24f7120 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:56 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:56 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 1073741824 Sep 25 16:27:56 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8902b3bf-a8b7-460a-83a8-8ad313bfdb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa77e6c-281d-4c8f-af0a-94caf9ca1cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf801fbc-171b-4803-bbab-0ef75cd9cc21]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Volume volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 (cc28e01d-418e-4c20-9bce-a1ea6c481a04): created successfully Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa77e6c-281d-4c8f-af0a-94caf9ca1cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (35075eaf-b209-475a-a9d2-47963280a099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-57600a4e-ff95-4fa0-8c19-b00d6d82cc8a tempest-CreateVolumesFromImageTest-1930951688 None] Created volume successfully. Sep 25 16:27:56 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD Sep 25 16:27:56 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:56 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:57 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 1073741824" returned: 0 in 0.693s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:57 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD Sep 25 16:27:57 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:57 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 Sep 25 16:27:57 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:57 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120" returned: 0 in 0.381s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:57 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD" returned: 1 in 0.505s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Temporary image f3f62c01-281f-4a36-a13a-55cadcf067cf is fetched for user 37843149ce434e96b59e65d90e88e9da. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb35b62f-d082-4034-86d6-c1f41bbe84e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05595afa-215a-48d1-83b1-1e78e156cbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Volume volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 (26ac1794-b9ef-4165-ad1c-cf16e24f7120): created successfully Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05595afa-215a-48d1-83b1-1e78e156cbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Flow 'volume_create_manager' (1f930b90-7b6a-4317-9782-7479c52a7c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-05554c48-05c3-453d-b84c-727fe7c17c3f tempest-CreateVolumesFromImageTest-1930951688 None] Created volume successfully. Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ebb622-3dbf-4a25-a6db-2e8bd4f444f6]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Flow 'volume_create_manager' (3065885b-265b-4e45-819b-ac50abbbd3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73673853-1672-4c51-8c70-177363a24e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:57 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD Sep 25 16:27:57 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73673853-1672-4c51-8c70-177363a24e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9020cbbf-9688-49e3-97bb-6bbafa278861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd4d44bb63248b6b8830c974ec05484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:58Z,use_quota=True,user_id='6fb5b683bbb44c7ebed46bee528bde3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de6cbabf-beaf-498f-8c73-8f71287dfbfd),volume_type_id=de6cbabf-beaf-498f-8c73-8f71287dfbfd)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724de232-ae3f-476a-89ed-71450e7911aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724de232-ae3f-476a-89ed-71450e7911aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17f225a-2068-478e-be44-d6348cee6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:57 devstack cinder-volume[87467]: DEBUG cinder.image.glance [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Creating Keystone auth plugin from conf {{(pid=87467) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-26ac1794-b9ef-4165-ad1c-cf16e24f7120-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-26ac1794-b9ef-4165-ad1c-cf16e24f7120-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-quobyte-26ac1794-b9ef-4165-ad1c-cf16e24f7120" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:27:58 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-26ac1794-b9ef-4165-ad1c-cf16e24f7120" acquired by "delete_volume" :: waited 0.045s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c047359a-3077-4361-afef-d11ee0f76239]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD Sep 25 16:27:58 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17f225a-2068-478e-be44-d6348cee6691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9020cbbf-9688-49e3-97bb-6bbafa278861', 'volume_name': 'volume-9020cbbf-9688-49e3-97bb-6bbafa278861', 'volume_size': 1, 'image_id': 'a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bceb10f21e227381d05348d13ed7919e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdd4d44bb63248b6b8830c974ec05484', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0745c31bb83d57082d8a629192e01c0adb7b84f901bbfac154eca6b4bf35c1c656c76597b29dba3bf639965e6fd1bb1afadfd166859d786c27f061dc23e67868', 'id': 'a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ecab5b-03fa-491c-af17-051600a8f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ecab5b-03fa-491c-af17-051600a8f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad7ebe-73e1-436c-bb05-ffa9871b4d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:27:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Volume 9020cbbf-9688-49e3-97bb-6bbafa278861: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9020cbbf-9688-49e3-97bb-6bbafa278861', 'volume_size': 1, 'image_id': 'a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bceb10f21e227381d05348d13ed7919e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdd4d44bb63248b6b8830c974ec05484', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0745c31bb83d57082d8a629192e01c0adb7b84f901bbfac154eca6b4bf35c1c656c76597b29dba3bf639965e6fd1bb1afadfd166859d786c27f061dc23e67868', 'id': 'a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Trying to clone 9020cbbf-9688-49e3-97bb-6bbafa278861 from image a0df63f6-4d67-4e81-a596-9fd87f88fbcb at location (None, [{'url': 'file:///opt/stack/data/glance/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'metadata': {}}]). {{(pid=87467) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 16:27:58 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 Sep 25 16:27:58 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 16:27:58 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Image download 0.00 MB at 0.00 MB/s Sep 25 16:27:58 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD" returned: 1 in 0.477s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f763f6-849e-4b57-aac3-f12406e68207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401609e15acc4471b12d5e8c8c58b631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:55Z,use_quota=True,user_id='37843149ce434e96b59e65d90e88e9da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Creating volume 01f763f6-849e-4b57-aac3-f12406e68207 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:27:58 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 1073741824 Sep 25 16:27:58 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f541fb4e-7fc8-4ec2-91e9-311596f894f5]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD Sep 25 16:27:58 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:58 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120" returned: 0 in 0.692s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:58 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120 Sep 25 16:27:58 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:59 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:59 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 1073741824" returned: 0 in 0.664s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD Sep 25 16:27:59 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:59 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-26ac1794-b9ef-4165-ad1c-cf16e24f7120" returned: 0 in 0.480s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 Sep 25 16:27:59 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-26ac1794-b9ef-4165-ad1c-cf16e24f7120" released by "delete_volume" :: held 1.247s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Created reservations ['5471a16f-90c2-421e-b50a-00886dd8722c', 'f4ed3ee8-a9b2-4d4a-a0f2-5b8779897229', '1fdd192b-000a-4ea3-8248-ad6ae7317943', 'b458cf8a-7dcb-45f6-958d-e0ef5dbad95d'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:59 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD" returned: 1 in 0.482s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Temporary image a0df63f6-4d67-4e81-a596-9fd87f88fbcb is fetched for user 6fb5b683bbb44c7ebed46bee528bde3a. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1455}} Sep 25 16:27:59 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:27:59 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:59 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1573ca3-38c9-477b-b6bd-869857a539f9]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207" returned: 0 in 0.469s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Attempting download of f3f62c01-281f-4a36-a13a-55cadcf067cf ((None, [{'url': 'file:///opt/stack/data/glance/images/f3f62c01-281f-4a36-a13a-55cadcf067cf', 'metadata': {}}])) to volume 01f763f6-849e-4b57-aac3-f12406e68207. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[31500ccd-42b3-4bd2-94f4-e3da4f8bcdde]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3f62c01-281f-4a36-a13a-55cadcf067cf__g_s040j {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:27:59 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD Sep 25 16:27:59 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:27:59 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:27:59 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:27:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Deleted volume successfully. Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-920060dc-9bcd-42b0-8e09-4cd28094e416 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-26ac1794-b9ef-4165-ad1c-cf16e24f7120-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:00 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3f62c01-281f-4a36-a13a-55cadcf067cf__g_s040j Sep 25 16:28:00 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-cc28e01d-418e-4c20-9bce-a1ea6c481a04-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-cc28e01d-418e-4c20-9bce-a1ea6c481a04-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:00 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3f62c01-281f-4a36-a13a-55cadcf067cf__g_s040j" returned: 0 in 0.453s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3f62c01-281f-4a36-a13a-55cadcf067cf__g_s040j {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD Sep 25 16:28:00 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-quobyte-cc28e01d-418e-4c20-9bce-a1ea6c481a04" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-cc28e01d-418e-4c20-9bce-a1ea6c481a04" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0794efa3-5f28-4652-9732-7228c4770099]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3f62c01-281f-4a36-a13a-55cadcf067cf__g_s040j Sep 25 16:28:00 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 Sep 25 16:28:00 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9020cbbf-9688-49e3-97bb-6bbafa278861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd4d44bb63248b6b8830c974ec05484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:27:58Z,use_quota=True,user_id='6fb5b683bbb44c7ebed46bee528bde3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de6cbabf-beaf-498f-8c73-8f71287dfbfd),volume_type_id=de6cbabf-beaf-498f-8c73-8f71287dfbfd)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Creating volume 9020cbbf-9688-49e3-97bb-6bbafa278861 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:00 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:00 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 1073741824 Sep 25 16:28:00 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:00 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3f62c01-281f-4a36-a13a-55cadcf067cf__g_s040j" returned: 1 in 0.450s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3f62c01-281f-4a36-a13a-55cadcf067cf__g_s040j' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[80804a6a-fcfd-4a73-8277-1a629b8eaec7]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:01 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD Sep 25 16:28:01 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:01 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04" returned: 0 in 0.600s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:01 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04 Sep 25 16:28:01 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:01 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:01 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 1073741824" returned: 0 in 0.614s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:01 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD Sep 25 16:28:01 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:01 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 Sep 25 16:28:01 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:01 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cc28e01d-418e-4c20-9bce-a1ea6c481a04" returned: 0 in 0.363s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-cc28e01d-418e-4c20-9bce-a1ea6c481a04" released by "delete_volume" :: held 1.054s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Created reservations ['e346c295-361e-488b-94a2-77fdc528457e', 'e93dd61e-d761-454c-b2d3-053376200e23', '85a4f266-f8e1-4b0e-86d5-bc0d021e28ef', '32ac03e0-bce1-47ef-b3c2-718f9cf683b6'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:01 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] f3f62c01-281f-4a36-a13a-55cadcf067cf was raw, converting to qcow2 {{(pid=87467) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:01 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 Sep 25 16:28:01 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:01 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:01 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:01 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861" returned: 0 in 0.414s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:01 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Attempting download of a0df63f6-4d67-4e81-a596-9fd87f88fbcb ((None, [{'url': 'file:///opt/stack/data/glance/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'metadata': {}}])) to volume 9020cbbf-9688-49e3-97bb-6bbafa278861. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b8c115-3efe-4872-9bfc-aba9fe86ccb5]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_6zwylfon {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:02 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_6zwylfon Sep 25 16:28:02 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:02 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.470s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:02 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Deleted volume successfully. Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b963131f-e3dc-4b9e-a8b0-2f3d3681ca7d tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-cc28e01d-418e-4c20-9bce-a1ea6c481a04-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:02 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207" returned: 0 in 0.785s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3f62c01-281f-4a36-a13a-55cadcf067cf_o62egaqtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:28:02 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:02 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_6zwylfon" returned: 0 in 0.516s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_6zwylfon {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:02 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 1G Sep 25 16:28:02 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-f2830e5b-f97d-42d7-bae0-a948a59df86c-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-f2830e5b-f97d-42d7-bae0-a948a59df86c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:02 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_6zwylfon Sep 25 16:28:02 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-quobyte-f2830e5b-f97d-42d7-bae0-a948a59df86c" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-f2830e5b-f97d-42d7-bae0-a948a59df86c" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a09f6-62d7-4b7d-8a8e-88cacce83e51]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:03 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 1G" returned: 0 in 0.482s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Downloaded image f3f62c01-281f-4a36-a13a-55cadcf067cf ((None, [{'url': 'file:///opt/stack/data/glance/images/f3f62c01-281f-4a36-a13a-55cadcf067cf', 'metadata': {}}])) to volume 01f763f6-849e-4b57-aac3-f12406e68207 successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Temporary image f3f62c01-281f-4a36-a13a-55cadcf067cf for user 37843149ce434e96b59e65d90e88e9da is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Marking volume 01f763f6-849e-4b57-aac3-f12406e68207 as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Copying metadata from image f3f62c01-281f-4a36-a13a-55cadcf067cf to 01f763f6-849e-4b57-aac3-f12406e68207. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Creating volume glance metadata for volume 01f763f6-849e-4b57-aac3-f12406e68207 backed by image f3f62c01-281f-4a36-a13a-55cadcf067cf with: {'image_id': 'f3f62c01-281f-4a36-a13a-55cadcf067cf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '96b630777f6766e465d73d15467694d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:28:03 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c Sep 25 16:28:03 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:03 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_6zwylfon" returned: 1 in 0.593s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_6zwylfon' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65c0b9c-c657-4643-ac34-197d12437858]: (4, 'raw') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae906b7-e6ed-454d-b878-274d3f17103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f763f6-849e-4b57-aac3-f12406e68207', 'volume_size': 1, 'image_id': 'f3f62c01-281f-4a36-a13a-55cadcf067cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3f62c01-281f-4a36-a13a-55cadcf067cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '96b630777f6766e465d73d15467694d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '401609e15acc4471b12d5e8c8c58b631', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a53650dd31699c3b8bb72c2d3f01c459ea8478a6abb788c1f730dfd3e5f119829a0554ba9e9c5e18d376ec39e43f926bc86c49a54e2e500b869bea4fc127253', 'id': 'f3f62c01-281f-4a36-a13a-55cadcf067cf', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3f62c01-281f-4a36-a13a-55cadcf067cf/file', 'properties': {}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc0666a-2902-4b9f-9b4e-702cc106aa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:03 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Volume volume-01f763f6-849e-4b57-aac3-f12406e68207 (01f763f6-849e-4b57-aac3-f12406e68207): created successfully Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc0666a-2902-4b9f-9b4e-702cc106aa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Flow 'volume_create_manager' (e96cdf82-d9ae-46e0-8647-7503975839c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:03 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c358b8c3-4ddf-4811-97ee-a9ecc8d5e7e4 tempest-VolumeImageDependencyTests-1388791140 None] Created volume successfully. Sep 25 16:28:03 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD Sep 25 16:28:03 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:03 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c" returned: 0 in 0.605s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:03 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c Sep 25 16:28:03 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:03 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:03 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD Sep 25 16:28:03 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:03 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f2830e5b-f97d-42d7-bae0-a948a59df86c" returned: 0 in 0.373s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-f2830e5b-f97d-42d7-bae0-a948a59df86c" released by "delete_volume" :: held 1.059s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Created reservations ['1b85c4b8-4ffb-4ccd-a8e1-47b7155625f4', 'c694c30c-99ab-4970-b149-7cf4d17ecd7e', 'd82b1649-f3b5-459d-8355-1362ea39efd5', '3c9389cb-cb02-4bf1-a2f9-6857462d44f7'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:04 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] a0df63f6-4d67-4e81-a596-9fd87f88fbcb was raw, converting to qcow2 {{(pid=87467) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:04 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 Sep 25 16:28:04 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:04 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:04 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:04 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.325s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Deleted volume successfully. Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c2d796c6-d28c-449c-9312-d332f2c2b573 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-f2830e5b-f97d-42d7-bae0-a948a59df86c-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Acquiring lock "cinder-01f763f6-849e-4b57-aac3-f12406e68207-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Lock "cinder-01f763f6-849e-4b57-aac3-f12406e68207-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Acquiring lock "cinder-quobyte-01f763f6-849e-4b57-aac3-f12406e68207" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Lock "cinder-quobyte-01f763f6-849e-4b57-aac3-f12406e68207" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[983ff3ff-108d-4422-8267-b885936ceebc]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:04 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861" returned: 0 in 0.745s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a0df63f6-4d67-4e81-a596-9fd87f88fbcb_wjq2eo4pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:28:04 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 16:28:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:04 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 1G Sep 25 16:28:04 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:04 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 Sep 25 16:28:04 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-aa265c0c-15a4-4feb-9ec3-8c3108a7a972-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-aa265c0c-15a4-4feb-9ec3-8c3108a7a972-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-quobyte-aa265c0c-15a4-4feb-9ec3-8c3108a7a972" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-aa265c0c-15a4-4feb-9ec3-8c3108a7a972" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1db0d7-8abd-4e29-acd3-32fad4d914bb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:05 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207" returned: 0 in 0.587s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:05 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 Sep 25 16:28:05 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207 Sep 25 16:28:05 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:05 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:05 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 1G" returned: 0 in 0.575s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Downloaded image a0df63f6-4d67-4e81-a596-9fd87f88fbcb ((None, [{'url': 'file:///opt/stack/data/glance/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'metadata': {}}])) to volume 9020cbbf-9688-49e3-97bb-6bbafa278861 successfully. {{(pid=87467) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Temporary image a0df63f6-4d67-4e81-a596-9fd87f88fbcb for user 6fb5b683bbb44c7ebed46bee528bde3a is deleted. {{(pid=87467) fetch /opt/stack/cinder/cinder/image/image_utils.py:1459}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.volume_utils [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Marking volume 9020cbbf-9688-49e3-97bb-6bbafa278861 as bootable. {{(pid=87467) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Copying metadata from image a0df63f6-4d67-4e81-a596-9fd87f88fbcb to 9020cbbf-9688-49e3-97bb-6bbafa278861. {{(pid=87467) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Creating volume glance metadata for volume 9020cbbf-9688-49e3-97bb-6bbafa278861 backed by image a0df63f6-4d67-4e81-a596-9fd87f88fbcb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bceb10f21e227381d05348d13ed7919e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87467) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad7ebe-73e1-436c-bb05-ffa9871b4d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9020cbbf-9688-49e3-97bb-6bbafa278861', 'volume_size': 1, 'image_id': 'a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bceb10f21e227381d05348d13ed7919e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fdd4d44bb63248b6b8830c974ec05484', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0745c31bb83d57082d8a629192e01c0adb7b84f901bbfac154eca6b4bf35c1c656c76597b29dba3bf639965e6fd1bb1afadfd166859d786c27f061dc23e67868', 'id': 'a0df63f6-4d67-4e81-a596-9fd87f88fbcb', 'created_at': datetime.datetime(2026, 9, 25, 14, 27, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 27, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0df63f6-4d67-4e81-a596-9fd87f88fbcb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7b8022-9b53-4513-88f9-af86845f69f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:05 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Volume volume-9020cbbf-9688-49e3-97bb-6bbafa278861 (9020cbbf-9688-49e3-97bb-6bbafa278861): created successfully Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7b8022-9b53-4513-88f9-af86845f69f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Flow 'volume_create_manager' (3065885b-265b-4e45-819b-ac50abbbd3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e097689a-6e6a-4754-bf34-bf064e994a42 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Created volume successfully. Sep 25 16:28:05 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-01f763f6-849e-4b57-aac3-f12406e68207" returned: 0 in 0.352s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Lock "cinder-quobyte-01f763f6-849e-4b57-aac3-f12406e68207" released by "delete_volume" :: held 0.999s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Created reservations ['0623bc28-b97c-4f36-90f7-7817b255bc13', '003b4d4a-2dff-4ce1-baed-ce184b25b598', '96cbb21f-547d-4271-970e-70233c21e29f', 'e5f13561-7ef4-4a20-bb85-9d5dee9465ed'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:05 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972" returned: 0 in 0.579s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:05 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972 Sep 25 16:28:05 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:06 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:06 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:06 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-aa265c0c-15a4-4feb-9ec3-8c3108a7a972" returned: 0 in 0.348s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-aa265c0c-15a4-4feb-9ec3-8c3108a7a972" released by "delete_volume" :: held 0.986s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:06 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.330s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Deleted volume successfully. Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Created reservations ['5f652ab7-6add-4bb7-9403-2f78b2b77aa5', '09c548a7-0094-4cb1-9f79-6feffacc177b', '5c3b94ed-4385-4f65-ae12-01749ffa510d', '32747480-3935-417a-b7f6-390aaed68df5'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3490de73-730c-4b48-9925-c879930d1f49 tempest-VolumeImageDependencyTests-1388791140 None] Lock "cinder-01f763f6-849e-4b57-aac3-f12406e68207-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:06 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:06 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Acquiring lock "cinder-9020cbbf-9688-49e3-97bb-6bbafa278861-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "cinder-9020cbbf-9688-49e3-97bb-6bbafa278861-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Acquiring lock "cinder-quobyte-9020cbbf-9688-49e3-97bb-6bbafa278861" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "cinder-quobyte-9020cbbf-9688-49e3-97bb-6bbafa278861" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dcc9d8-3255-4f27-b781-1bb0892f617f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:06 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.356s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Deleted volume successfully. Sep 25 16:28:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f49bb2-c979-4324-8a58-9529f029afd9 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-aa265c0c-15a4-4feb-9ec3-8c3108a7a972-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:06 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 Sep 25 16:28:06 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:07 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861" returned: 0 in 0.511s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:07 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861 Sep 25 16:28:07 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "cinder-quobyte-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c7f985-3e56-4cd5-a6bc-3a10aaaafa27]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:07 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-9020cbbf-9688-49e3-97bb-6bbafa278861" returned: 0 in 0.494s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "cinder-quobyte-9020cbbf-9688-49e3-97bb-6bbafa278861" released by "delete_volume" :: held 1.078s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:07 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a Sep 25 16:28:07 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:07 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Created reservations ['723a4fed-7504-484e-b428-a01231e7502b', '28be8736-5245-4d0c-8f31-f2be62702999', '00ec4bf9-68b2-4fa0-9e6e-846e5eeb370b', '46f40243-e6ac-470f-b515-7106c6f7e8aa'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:08 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:08 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:08 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a" returned: 0 in 0.690s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:08 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a Sep 25 16:28:08 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:08 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.358s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:08 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Deleted volume successfully. Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5ef36609-a6d3-420a-8352-4bfaaa652aa0 tempest-VolumeAndVolumeTypeFromImageTest-898119670 None] Lock "cinder-9020cbbf-9688-49e3-97bb-6bbafa278861-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:08 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a" returned: 0 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-quobyte-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a" released by "delete_volume" :: held 1.149s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Created reservations ['c7f3669d-5730-49e6-a5b8-a1fe03679268', 'cb9929d7-946f-4688-a6ef-5bc267559f11', '3f91921d-b314-44d8-9de1-2ce7f6457036', '19d6ec0f-e8ac-4add-9c09-95b5f90f5489'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:09 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:09 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:09 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.377s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:09 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:09 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Deleted volume successfully. Sep 25 16:28:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ddab3ef5-c29d-4d89-9da7-d31492a4dc11 tempest-CreateVolumesFromImageTest-1930951688 None] Lock "cinder-d76a4323-d8c5-4b70-bb1c-9c71ed42ac5a-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Flow 'volume_create_manager' (22b075d7-9eb7-4455-a2ab-10ea4a736f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449ff52e-3a1c-4b17-88e3-b60e9d877d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449ff52e-3a1c-4b17-88e3-b60e9d877d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7ff6c2-103f-42d8-a2de-90b80b67ac03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720d6322cf764e01a7cbcd3f792acbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:12Z,use_quota=True,user_id='83f871fcb667425590070259ce96b203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6221fea-c0fc-4313-9fbc-bc5191958b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6221fea-c0fc-4313-9fbc-bc5191958b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f80b7-55cd-448c-be71-40af7f6367bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f80b7-55cd-448c-be71-40af7f6367bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7ff6c2-103f-42d8-a2de-90b80b67ac03', 'volume_name': 'volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf43cda-f504-4ed7-842b-feee0568b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf43cda-f504-4ed7-842b-feee0568b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ba10a6-afe3-464f-b9d7-51f7e9f08b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:12 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Volume cd7ff6c2-103f-42d8-a2de-90b80b67ac03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03', 'volume_size': 1} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7ff6c2-103f-42d8-a2de-90b80b67ac03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720d6322cf764e01a7cbcd3f792acbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:12Z,use_quota=True,user_id='83f871fcb667425590070259ce96b203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Creating volume cd7ff6c2-103f-42d8-a2de-90b80b67ac03 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:12 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:12 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 1073741824 Sep 25 16:28:12 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:13 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 1073741824" returned: 0 in 0.708s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:13 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 Sep 25 16:28:13 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:13 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03" returned: 0 in 0.363s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ba10a6-afe3-464f-b9d7-51f7e9f08b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca8e70e-0976-42cc-811c-60ac90445750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:13 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Volume volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 (cd7ff6c2-103f-42d8-a2de-90b80b67ac03): created successfully Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca8e70e-0976-42cc-811c-60ac90445750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:13 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Flow 'volume_create_manager' (22b075d7-9eb7-4455-a2ab-10ea4a736f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:13 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5e5778de-7171-4464-a6b0-ebeaf1fcacf5 tempest-CinderUnicodeTest-61788614 None] Created volume successfully. Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (3fe347bb-c4c4-4d59-bf84-0627c53accd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8f0ede-a695-42a5-a18b-91ae1a531071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8f0ede-a695-42a5-a18b-91ae1a531071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530883650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb61a787-2e27-4b33-9f9d-a7c7e549ded1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:15Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf901607-f6cf-4b65-863b-cc7e59ab5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf901607-f6cf-4b65-863b-cc7e59ab5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec79ad8-48c4-4a65-b1fa-ec77762cd7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec79ad8-48c4-4a65-b1fa-ec77762cd7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb61a787-2e27-4b33-9f9d-a7c7e549ded1', 'volume_name': 'volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1014585a-ffc4-465c-9657-ff1958254c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1014585a-ffc4-465c-9657-ff1958254c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec93916f-7533-41c5-9fcf-749e83c4379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume bb61a787-2e27-4b33-9f9d-a7c7e549ded1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1', 'volume_size': 1} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530883650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb61a787-2e27-4b33-9f9d-a7c7e549ded1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:15Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Creating volume bb61a787-2e27-4b33-9f9d-a7c7e549ded1 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:15 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:15 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 1073741824 Sep 25 16:28:15 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Flow 'volume_create_manager' (1a94509c-576c-4163-9ab1-1e9d40a7a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed3c13c-7a28-40e1-a147-1ddfa08beef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:15 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed3c13c-7a28-40e1-a147-1ddfa08beef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1980404963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efadee92-233e-4e74-a59c-5d3068028a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720d6322cf764e01a7cbcd3f792acbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:15Z,use_quota=True,user_id='83f871fcb667425590070259ce96b203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b790035e-dabb-4b5a-9282-e7f5ec31b5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b790035e-dabb-4b5a-9282-e7f5ec31b5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73115ea1-cbb8-4b40-a004-c02e51432ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73115ea1-cbb8-4b40-a004-c02e51432ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efadee92-233e-4e74-a59c-5d3068028a7f', 'volume_name': 'volume-efadee92-233e-4e74-a59c-5d3068028a7f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a40425-cd2a-4c0c-9fcf-e706d12681cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a40425-cd2a-4c0c-9fcf-e706d12681cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a6a2ad-51be-4e1e-ab32-c53330dd5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:15 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Volume efadee92-233e-4e74-a59c-5d3068028a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efadee92-233e-4e74-a59c-5d3068028a7f', 'volume_size': 1} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:15 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.411s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:28:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:28:16 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 1073741824" returned: 0 in 0.779s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:16 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 Sep 25 16:28:16 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:16 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1" returned: 0 in 0.380s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1980404963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efadee92-233e-4e74-a59c-5d3068028a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720d6322cf764e01a7cbcd3f792acbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:15Z,use_quota=True,user_id='83f871fcb667425590070259ce96b203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Creating volume efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:16 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:16 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f 1073741824 Sep 25 16:28:16 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec93916f-7533-41c5-9fcf-749e83c4379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edf0808-3f00-4ab2-882f-67e4cec4af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 (bb61a787-2e27-4b33-9f9d-a7c7e549ded1): created successfully Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edf0808-3f00-4ab2-882f-67e4cec4af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (3fe347bb-c4c4-4d59-bf84-0627c53accd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-dba0a1f6-a06e-450c-8c71-bbb1288d197d tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created volume successfully. Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (3d34a7a8-7ada-48c0-9d32-7f56f0ac3e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c1314a-72f1-4e5f-9ce0-09aa0aaf9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c1314a-72f1-4e5f-9ce0-09aa0aaf9007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1118885213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44afc280-1b80-4f41-889c-63c17cd6a71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:17Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb865c4-7131-48b7-8846-03179583f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb865c4-7131-48b7-8846-03179583f961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52a417-fdd9-42e5-8d2c-94cd58b698e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c52a417-fdd9-42e5-8d2c-94cd58b698e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44afc280-1b80-4f41-889c-63c17cd6a71b', 'volume_name': 'volume-44afc280-1b80-4f41-889c-63c17cd6a71b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e3f01a-75da-4131-a7cf-5bf55ee5be19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e3f01a-75da-4131-a7cf-5bf55ee5be19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2a9813-e4a1-4a0c-8f27-db74bf04b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:16 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume 44afc280-1b80-4f41-889c-63c17cd6a71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44afc280-1b80-4f41-889c-63c17cd6a71b', 'volume_size': 1} Sep 25 16:28:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:17 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f 1073741824" returned: 0 in 0.607s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:17 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f Sep 25 16:28:17 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:17 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f" returned: 0 in 0.409s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1118885213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44afc280-1b80-4f41-889c-63c17cd6a71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:17Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Creating volume 44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:17 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:17 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b 1073741824 Sep 25 16:28:17 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a6a2ad-51be-4e1e-ab32-c53330dd5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efadee92-233e-4e74-a59c-5d3068028a7f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d4a0d2-ada3-4e77-af9a-e01984352203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (8d579cce-f92c-445b-ab41-85fb56e066ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787e4c1-1f2f-4ec5-b776-fb8abd6deff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Volume volume-efadee92-233e-4e74-a59c-5d3068028a7f (efadee92-233e-4e74-a59c-5d3068028a7f): created successfully Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d4a0d2-ada3-4e77-af9a-e01984352203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Flow 'volume_create_manager' (1a94509c-576c-4163-9ab1-1e9d40a7a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7787e4c1-1f2f-4ec5-b776-fb8abd6deff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936885901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47f341f-2b78-413c-9339-4d1f440da34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:18Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3df27f2-bf38-4102-9ba8-155364b8fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3df27f2-bf38-4102-9ba8-155364b8fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb08c20e-b927-4716-a527-f3513c3625bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb08c20e-b927-4716-a527-f3513c3625bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47f341f-2b78-413c-9339-4d1f440da34f', 'volume_name': 'volume-d47f341f-2b78-413c-9339-4d1f440da34f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d02acb5-1269-417b-ace0-a17c82b2665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d02acb5-1269-417b-ace0-a17c82b2665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0984cd4-4dac-4b4c-9b60-617c4a7f597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume d47f341f-2b78-413c-9339-4d1f440da34f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47f341f-2b78-413c-9339-4d1f440da34f', 'volume_size': 1} Sep 25 16:28:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-2874262c-3e81-46fb-aed5-7178d9f98f79 tempest-CinderUnicodeTest-61788614 None] Created volume successfully. Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (e63d6092-5901-40d8-ba30-84f79868f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2170cb5c-caa6-414e-938a-0e75e1aa2827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2170cb5c-caa6-414e-938a-0e75e1aa2827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1584508700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fb66e3-38ef-4b7f-8c40-acfe67effa5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:18Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f308f2e2-9cf7-45cd-a8dd-8d2e8c822b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f308f2e2-9cf7-45cd-a8dd-8d2e8c822b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf9b91a-2f08-4f4c-a703-390e97496ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf9b91a-2f08-4f4c-a703-390e97496ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fb66e3-38ef-4b7f-8c40-acfe67effa5e', 'volume_name': 'volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf030f96-d931-40bb-ba8f-0988eb90b17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf030f96-d931-40bb-ba8f-0988eb90b17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb6725a-035e-4af3-a7ab-6f43f22bf8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:18 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume 06fb66e3-38ef-4b7f-8c40-acfe67effa5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e', 'volume_size': 1} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:18 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b 1073741824" returned: 0 in 0.693s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:18 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b Sep 25 16:28:18 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:18 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b" returned: 0 in 0.492s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936885901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47f341f-2b78-413c-9339-4d1f440da34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:18Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Creating volume d47f341f-2b78-413c-9339-4d1f440da34f {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:18 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:18 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f 1073741824 Sep 25 16:28:18 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2a9813-e4a1-4a0c-8f27-db74bf04b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44afc280-1b80-4f41-889c-63c17cd6a71b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ea5437-6aea-4c16-aa8c-65262ca63205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume volume-44afc280-1b80-4f41-889c-63c17cd6a71b (44afc280-1b80-4f41-889c-63c17cd6a71b): created successfully Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ea5437-6aea-4c16-aa8c-65262ca63205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (3d34a7a8-7ada-48c0-9d32-7f56f0ac3e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (b55b2cd8-c19e-4ad8-9cc4-1b1e55bca9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81538d4c-32ed-48b4-813b-1dd03bb20db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:19 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9b639f6f-914d-48e1-9f34-60eb828f77d1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created volume successfully. Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81538d4c-32ed-48b4-813b-1dd03bb20db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1118970269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d62b70-3ce8-47e1-b718-5dba467d9984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:19Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7218e35-1342-46a3-9d95-e38e6966627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7218e35-1342-46a3-9d95-e38e6966627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f258a515-0e0b-45d8-a858-9ad50e882713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f258a515-0e0b-45d8-a858-9ad50e882713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d62b70-3ce8-47e1-b718-5dba467d9984', 'volume_name': 'volume-40d62b70-3ce8-47e1-b718-5dba467d9984', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1077b6-638c-4a3a-83e5-9bb7dc0bb0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1077b6-638c-4a3a-83e5-9bb7dc0bb0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d238f9-31e9-479a-a805-8828012f7d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume 40d62b70-3ce8-47e1-b718-5dba467d9984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d62b70-3ce8-47e1-b718-5dba467d9984', 'volume_size': 1} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (671ee02a-4add-4922-aae2-65c6918ccd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb10d6-635f-42f6-8fdd-97863664f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb10d6-635f-42f6-8fdd-97863664f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430552103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b7dd7c-431f-4f38-bc3d-f9daf54e0914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:19Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa96dbe-688d-480a-a29c-de894767ed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa96dbe-688d-480a-a29c-de894767ed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bbb380-02e8-411f-bba5-c008d44e136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bbb380-02e8-411f-bba5-c008d44e136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b7dd7c-431f-4f38-bc3d-f9daf54e0914', 'volume_name': 'volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0e613e-22e1-4ed7-8257-1596a02ab5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0e613e-22e1-4ed7-8257-1596a02ab5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb21587-edd4-486b-8750-08cd99a30031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:19 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume 30b7dd7c-431f-4f38-bc3d-f9daf54e0914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914', 'volume_size': 1} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f 1073741824" returned: 0 in 0.762s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:19 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f Sep 25 16:28:19 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:20 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f" returned: 0 in 0.364s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.861s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1584508700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fb66e3-38ef-4b7f-8c40-acfe67effa5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:18Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Creating volume 06fb66e3-38ef-4b7f-8c40-acfe67effa5e {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:20 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0984cd4-4dac-4b4c-9b60-617c4a7f597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47f341f-2b78-413c-9339-4d1f440da34f', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:20 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e 1073741824 Sep 25 16:28:20 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a046f513-813b-4436-b8a0-7277515c4642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (c61047cf-a203-487e-9c52-68b65ae9e9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c9d0de-6544-41d9-acf4-cb0294cececb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c9d0de-6544-41d9-acf4-cb0294cececb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1685270436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f232bdf9-61fe-40ba-91e1-b550964a8c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:20Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4a3337-393d-4c8f-a84b-09bc6bfec7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4a3337-393d-4c8f-a84b-09bc6bfec7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fcfb86-9b87-4a07-8203-85f7a0c4b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fcfb86-9b87-4a07-8203-85f7a0c4b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f232bdf9-61fe-40ba-91e1-b550964a8c25', 'volume_name': 'volume-f232bdf9-61fe-40ba-91e1-b550964a8c25', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219f1031-0d24-4d84-8992-8de332cfd921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219f1031-0d24-4d84-8992-8de332cfd921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a32e69e-22df-4116-9fc7-b63933715a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume f232bdf9-61fe-40ba-91e1-b550964a8c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f232bdf9-61fe-40ba-91e1-b550964a8c25', 'volume_size': 1} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume volume-d47f341f-2b78-413c-9339-4d1f440da34f (d47f341f-2b78-413c-9339-4d1f440da34f): created successfully Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a046f513-813b-4436-b8a0-7277515c4642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (8d579cce-f92c-445b-ab41-85fb56e066ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b7f5a31c-a64e-427e-9744-de8a01ea6fa9 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created volume successfully. Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:20 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e 1073741824" returned: 0 in 0.608s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:20 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e Sep 25 16:28:20 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:21 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e" returned: 0 in 0.476s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.108s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb6725a-035e-4af3-a7ab-6f43f22bf8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e82012-8f74-4ac1-a03a-6878ddbe2cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Creating offline snapshot d5cd8397-c3af-4298-b96c-cf0079709946 of volume efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f733dc-9c6e-4158-b4e5-d476d4a59333]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:21 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e (06fb66e3-38ef-4b7f-8c40-acfe67effa5e): created successfully Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e82012-8f74-4ac1-a03a-6878ddbe2cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (e63d6092-5901-40d8-ba30-84f79868f429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:21 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f Sep 25 16:28:21 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3a19b008-f02a-47e4-b64c-f2c19d0f8f16 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created volume successfully. Sep 25 16:28:21 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f" returned: 0 in 0.477s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:21 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 1G Sep 25 16:28:21 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:22 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 1G" returned: 0 in 0.559s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efadee92-233e-4e74-a59c-5d3068028a7f -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:22 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efadee92-233e-4e74-a59c-5d3068028a7f -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 Sep 25 16:28:22 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:22 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efadee92-233e-4e74-a59c-5d3068028a7f -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946" returned: 0 in 0.367s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:22 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 is being set with open permissions: ugo+rw Sep 25 16:28:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:22 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 Sep 25 16:28:22 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:23 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946" returned: 0 in 0.309s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:23 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.info Sep 25 16:28:23 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:23 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.info" returned: 0 in 0.321s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:23 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.info is being set with open permissions: ugo+rw Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:23 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.info Sep 25 16:28:23 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:23 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.info" returned: 0 in 0.289s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.485s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1118970269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d62b70-3ce8-47e1-b718-5dba467d9984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:19Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Creating volume 40d62b70-3ce8-47e1-b718-5dba467d9984 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:23 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:23 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 1073741824 Sep 25 16:28:23 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-25d0e4ad-51cc-4d20-9bcf-7bf3305c1713 tempest-CinderUnicodeTest-61788614 None] Create snapshot completed successfully Sep 25 16:28:24 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "cinder-d5cd8397-c3af-4298-b96c-cf0079709946-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 1073741824" returned: 0 in 0.610s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-d5cd8397-c3af-4298-b96c-cf0079709946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "cinder-quobyte-efadee92-233e-4e74-a59c-5d3068028a7f" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-efadee92-233e-4e74-a59c-5d3068028a7f" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "cinder-quobyte-d5cd8397-c3af-4298-b96c-cf0079709946" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-d5cd8397-c3af-4298-b96c-cf0079709946" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Deleting offline snapshot d5cd8397-c3af-4298-b96c-cf0079709946 of volume efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:24 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 Sep 25 16:28:24 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] snapshot_file for this snap is: volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89521587-ffb8-454b-a56d-f57f64e5e7c6]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:24 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 Sep 25 16:28:24 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:24 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984" returned: 0 in 0.385s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.178s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430552103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b7dd7c-431f-4f38-bc3d-f9daf54e0914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:19Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Creating volume 30b7dd7c-431f-4f38-bc3d-f9daf54e0914 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:24 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d238f9-31e9-479a-a805-8828012f7d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d62b70-3ce8-47e1-b718-5dba467d9984', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:24 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 1073741824 Sep 25 16:28:24 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b01d66-f476-4765-80e2-ad1be9ee0a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:24 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume volume-40d62b70-3ce8-47e1-b718-5dba467d9984 (40d62b70-3ce8-47e1-b718-5dba467d9984): created successfully Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b01d66-f476-4765-80e2-ad1be9ee0a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (b55b2cd8-c19e-4ad8-9cc4-1b1e55bca9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b296e0cf-a1aa-4172-994d-f82cd3595d33 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created volume successfully. Sep 25 16:28:25 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946" returned: 0 in 0.474s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efadee92-233e-4e74-a59c-5d3068028a7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a29d3-0a34-4686-a274-3778bea11bf0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:25 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f Sep 25 16:28:25 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:25 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 1073741824" returned: 0 in 0.642s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:25 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f" returned: 0 in 0.495s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:25 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 Sep 25 16:28:25 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:25 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 Sep 25 16:28:25 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:25 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914" returned: 0 in 0.283s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.602s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1685270436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f232bdf9-61fe-40ba-91e1-b550964a8c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1644445485464a2284ef5cc19903b1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:20Z,use_quota=True,user_id='8cb13e76d50942a5b930a5127bb0a490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Creating volume f232bdf9-61fe-40ba-91e1-b550964a8c25 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:25 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb21587-edd4-486b-8750-08cd99a30031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed1f03-54af-4fd8-b76a-26d00d3a4a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:25 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 1073741824 Sep 25 16:28:25 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 (30b7dd7c-431f-4f38-bc3d-f9daf54e0914): created successfully Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed1f03-54af-4fd8-b76a-26d00d3a4a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (671ee02a-4add-4922-aae2-65c6918ccd8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f23018e5-b734-4101-8fa1-d589b3ecedab tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created volume successfully. Sep 25 16:28:26 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946" returned: 0 in 0.469s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:26 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946 Sep 25 16:28:26 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:26 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f.d5cd8397-c3af-4298-b96c-cf0079709946" returned: 0 in 0.353s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-d5cd8397-c3af-4298-b96c-cf0079709946" released by "_delete_snapshot" :: held 1.950s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-efadee92-233e-4e74-a59c-5d3068028a7f" released by "delete_snapshot" :: held 2.027s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:26 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 1073741824" returned: 0 in 0.581s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:26 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 Sep 25 16:28:26 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Created reservations ['03d09bdb-4fb2-4a17-9666-ce7824e7e7cc', '267f44a8-36ed-40dd-be22-f876fc7ce7d8', 'd8c95257-660c-46c5-851c-c6151e9ab65b', '195c451b-b719-4be2-bd05-f96e83de1e48'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Delete snapshot completed successfully. Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c3bdfcf0-7166-456a-99fb-5a3554be9393 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-d5cd8397-c3af-4298-b96c-cf0079709946-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:26 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25" returned: 0 in 0.327s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.513s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a32e69e-22df-4116-9fc7-b63933715a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f232bdf9-61fe-40ba-91e1-b550964a8c25', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a8de61-042f-4f91-9922-59fb527f6352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Creating offline snapshot e51d379c-fb0b-4d48-83ae-2e708dc18662 of volume 44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:26 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Volume volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 (f232bdf9-61fe-40ba-91e1-b550964a8c25): created successfully Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a8de61-042f-4f91-9922-59fb527f6352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Flow 'volume_create_manager' (c61047cf-a203-487e-9c52-68b65ae9e9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e47fe8-20ee-4943-97ea-04de9df1ed85]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d0c995d2-5b15-45b2-86dc-f35d587be3ee tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created volume successfully. Sep 25 16:28:27 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b Sep 25 16:28:27 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:27 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b" returned: 0 in 0.430s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:27 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 1G Sep 25 16:28:27 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "cinder-efadee92-233e-4e74-a59c-5d3068028a7f-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-efadee92-233e-4e74-a59c-5d3068028a7f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "cinder-quobyte-efadee92-233e-4e74-a59c-5d3068028a7f" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-efadee92-233e-4e74-a59c-5d3068028a7f" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9b615a-8ec9-4e15-aca8-a9ba29fa0df9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:27 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f Sep 25 16:28:27 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:27 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 1G" returned: 0 in 0.593s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44afc280-1b80-4f41-889c-63c17cd6a71b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44afc280-1b80-4f41-889c-63c17cd6a71b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 Sep 25 16:28:28 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-f232bdf9-61fe-40ba-91e1-b550964a8c25-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-f232bdf9-61fe-40ba-91e1-b550964a8c25-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-quobyte-f232bdf9-61fe-40ba-91e1-b550964a8c25" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-f232bdf9-61fe-40ba-91e1-b550964a8c25" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb8e675-8914-48da-a78a-ffce2d5cc916]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f" returned: 0 in 0.527s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f Sep 25 16:28:28 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 Sep 25 16:28:28 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44afc280-1b80-4f41-889c-63c17cd6a71b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662" returned: 0 in 0.439s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 is being set with open permissions: ugo+rw Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 Sep 25 16:28:28 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-efadee92-233e-4e74-a59c-5d3068028a7f" returned: 0 in 0.559s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25" returned: 0 in 0.628s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:28 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-efadee92-233e-4e74-a59c-5d3068028a7f" released by "delete_volume" :: held 1.186s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662" returned: 0 in 0.489s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:28 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25 Sep 25 16:28:28 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Created reservations ['f36fb896-3bad-49c0-aff5-582e7cfeedf2', 'a84c5514-0a75-4dbb-91dc-f545fa411e02', 'e577b32e-6685-43df-a99a-5ca06a28d0e8', 'b8136756-8735-47a7-9780-93beac41b56f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:29 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.info Sep 25 16:28:29 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:29 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:29 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:29 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f232bdf9-61fe-40ba-91e1-b550964a8c25" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-f232bdf9-61fe-40ba-91e1-b550964a8c25" released by "delete_volume" :: held 1.137s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created reservations ['91640607-ee2c-4cff-89ac-d66cbc35d0e7', 'a303a37a-42ad-4242-a235-1fe1704dcebc', 'aa8059e1-f403-48b0-8d23-31d9114fe6fc', 'bf42ee64-bc9c-42c0-8df4-84c1ae463eca'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:29 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.info" returned: 0 in 0.492s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.info is being set with open permissions: ugo+rw Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:29 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.info Sep 25 16:28:29 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:29 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.454s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Deleted volume successfully. Sep 25 16:28:29 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:29 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfedf8c3-7c92-4df5-a50f-f373e79aa7b0 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-efadee92-233e-4e74-a59c-5d3068028a7f-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:29 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.info" returned: 0 in 0.331s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5e1fcd20-3679-486e-ae69-c81db2d66957 tempest-CreateVolumesFromSnapshotTest-988726382 None] Create snapshot completed successfully Sep 25 16:28:29 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.329s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Deleted volume successfully. Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5a2e3dfe-4e3e-406e-b9ea-1bd36417bb60 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-f232bdf9-61fe-40ba-91e1-b550964a8c25-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "cinder-cd7ff6c2-103f-42d8-a2de-90b80b67ac03-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-cd7ff6c2-103f-42d8-a2de-90b80b67ac03-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "cinder-quobyte-cd7ff6c2-103f-42d8-a2de-90b80b67ac03" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-cd7ff6c2-103f-42d8-a2de-90b80b67ac03" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740d5d1-104f-4473-a035-2663f76d563f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:30 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 Sep 25 16:28:30 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-30b7dd7c-431f-4f38-bc3d-f9daf54e0914-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-30b7dd7c-431f-4f38-bc3d-f9daf54e0914-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-quobyte-30b7dd7c-431f-4f38-bc3d-f9daf54e0914" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-30b7dd7c-431f-4f38-bc3d-f9daf54e0914" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb5d1ce-172a-4a67-9d12-c594445792f5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:30 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03" returned: 0 in 0.494s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:30 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03 Sep 25 16:28:30 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:30 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 Sep 25 16:28:30 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:30 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd7ff6c2-103f-42d8-a2de-90b80b67ac03" returned: 0 in 0.340s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-quobyte-cd7ff6c2-103f-42d8-a2de-90b80b67ac03" released by "delete_volume" :: held 0.897s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Created reservations ['ff637d4d-7920-40d6-aa86-031f8cb684ca', 'b8534e1a-7c65-4dcb-946f-2638043e707f', 'fc61adc7-3a16-4915-9782-a3383457f0e8', 'd784f5c3-82ff-4ca1-8677-e5c85823f6f6'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:31 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914" returned: 0 in 0.539s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:31 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914 Sep 25 16:28:31 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:31 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:31 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:31 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-30b7dd7c-431f-4f38-bc3d-f9daf54e0914" returned: 0 in 0.474s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-30b7dd7c-431f-4f38-bc3d-f9daf54e0914" released by "delete_volume" :: held 1.084s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:31 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.453s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Deleted volume successfully. Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-9b3a96f5-c9b7-42eb-8765-f08f7b100042 tempest-CinderUnicodeTest-61788614 None] Lock "cinder-cd7ff6c2-103f-42d8-a2de-90b80b67ac03-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created reservations ['b8781c0e-9b02-4acc-a225-0e836876c055', 'bd396372-0d80-4245-8007-c630071aacc2', 'ae34eccf-d0be-495b-8727-3b6db4798d5e', '651b1bf8-b354-4089-bff6-ff4705f7560c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (a76f8b99-ab44-43a1-a916-fbebcd1b6810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d14fe3a-fcd5-4cc6-8704-764909cf71c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d14fe3a-fcd5-4cc6-8704-764909cf71c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1667163020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ffb702-06dd-4f2f-bae0-fa58e48759b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:32Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2344a18-9c02-42f8-ae68-395ed42e4ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2344a18-9c02-42f8-ae68-395ed42e4ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455a9611-7bed-4dac-b459-68f0688f2685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455a9611-7bed-4dac-b459-68f0688f2685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ffb702-06dd-4f2f-bae0-fa58e48759b9', 'volume_name': 'volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca76f3c-fcfc-49f4-9d4d-0bfc70c17cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:31 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca76f3c-fcfc-49f4-9d4d-0bfc70c17cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f8700e-d1a8-4b64-90fa-7d81f428c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:32 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume 71ffb702-06dd-4f2f-bae0-fa58e48759b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9', 'volume_size': 1} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1667163020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ffb702-06dd-4f2f-bae0-fa58e48759b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:32Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Creating volume 71ffb702-06dd-4f2f-bae0-fa58e48759b9 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:32 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:32 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 1073741824 Sep 25 16:28:32 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:32 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:32 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (04826ca3-917a-4c91-9164-962cf95eb014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66e1aa5-47c7-40aa-84a5-d2f9a302429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66e1aa5-47c7-40aa-84a5-d2f9a302429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673694317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:32Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:32 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b76d7cd-88c6-4402-8663-eb3a83ebb326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b76d7cd-88c6-4402-8663-eb3a83ebb326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fda1ca-75ee-4aad-b39f-0d8c00c7e9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fda1ca-75ee-4aad-b39f-0d8c00c7e9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd', 'volume_name': 'volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f523ef7-3bee-4f6f-abd0-a7ff8e680216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f523ef7-3bee-4f6f-abd0-a7ff8e680216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690b1c4c-d892-46f3-afc1-b15192974f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:32 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume 29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd', 'volume_size': 1} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.486s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:32 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Deleted volume successfully. Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-7202fe33-82b2-4603-8348-55bd077a3eeb tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-30b7dd7c-431f-4f38-bc3d-f9daf54e0914-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:32 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 1073741824" returned: 0 in 0.744s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:32 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 Sep 25 16:28:32 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-40d62b70-3ce8-47e1-b718-5dba467d9984-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-40d62b70-3ce8-47e1-b718-5dba467d9984-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-quobyte-40d62b70-3ce8-47e1-b718-5dba467d9984" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-40d62b70-3ce8-47e1-b718-5dba467d9984" acquired by "delete_volume" :: waited 0.036s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad84bfd-07d5-4433-8a4a-c7f7bdab5c2e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:33 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9" returned: 0 in 0.490s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673694317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:32Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Creating volume 29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:33 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f8700e-d1a8-4b64-90fa-7d81f428c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847cbed4-0003-4a5c-9b17-f80a08c8d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:33 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd 1073741824 Sep 25 16:28:33 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:33 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 Sep 25 16:28:33 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (e4ba7c77-1b98-46ee-89c0-b857556831ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50039dd-b71d-4278-8da8-dcd70932acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:33 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 (71ffb702-06dd-4f2f-bae0-fa58e48759b9): created successfully Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847cbed4-0003-4a5c-9b17-f80a08c8d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (a76f8b99-ab44-43a1-a916-fbebcd1b6810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50039dd-b71d-4278-8da8-dcd70932acf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509204045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4736dd-cf82-438d-8f1e-118185b62077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:33Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51829fa2-60f3-43c3-b36f-4ec00a151178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51829fa2-60f3-43c3-b36f-4ec00a151178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603130e5-f7fe-42ad-89a9-1581f2fce3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603130e5-f7fe-42ad-89a9-1581f2fce3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4736dd-cf82-438d-8f1e-118185b62077', 'volume_name': 'volume-ec4736dd-cf82-438d-8f1e-118185b62077', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de078de1-005f-4d77-b5c4-ca6d3c17a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de078de1-005f-4d77-b5c4-ca6d3c17a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c45c2aa-9ab4-48df-87c7-425631bd294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:33 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume ec4736dd-cf82-438d-8f1e-118185b62077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4736dd-cf82-438d-8f1e-118185b62077', 'volume_size': 1} Sep 25 16:28:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b7e0d19d-cff3-4e32-9bb8-5dd60b3c6947 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created volume successfully. Sep 25 16:28:34 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984" returned: 0 in 0.889s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984 Sep 25 16:28:34 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (5185437d-b87f-441c-a9b9-858d6f08681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054fbd43-095c-4ad3-98ba-e8b379649ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd 1073741824" returned: 0 in 0.936s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054fbd43-095c-4ad3-98ba-e8b379649ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028743742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7690d9e4-1756-4649-96bc-e579125aec72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:34Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f79ffaf-19b1-4ce2-89ce-773fa8fdf280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f79ffaf-19b1-4ce2-89ce-773fa8fdf280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0535112e-31c6-4ab8-b360-db135e37a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0535112e-31c6-4ab8-b360-db135e37a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7690d9e4-1756-4649-96bc-e579125aec72', 'volume_name': 'volume-7690d9e4-1756-4649-96bc-e579125aec72', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7ebcdf-2c13-4c0e-b227-7b0936b51499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7ebcdf-2c13-4c0e-b227-7b0936b51499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3243b2-dab2-4ef2-9c37-38b2a9bc032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:34 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume 7690d9e4-1756-4649-96bc-e579125aec72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7690d9e4-1756-4649-96bc-e579125aec72', 'volume_size': 1} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:34 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-40d62b70-3ce8-47e1-b718-5dba467d9984" returned: 0 in 0.410s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-40d62b70-3ce8-47e1-b718-5dba467d9984" released by "delete_volume" :: held 1.397s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:34 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd Sep 25 16:28:34 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created reservations ['2bf5b06b-45d9-466c-988b-da6b2f6ec399', 'b7fbe71e-f651-4e6c-9403-dd16cd4c675e', '0edaf929-b2fd-44e4-bf0f-591a936740d9', 'c9e200d7-0667-4e20-a805-b0cdbbca16cc'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:34 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:34 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:34 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:34 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (92126610-3bc9-47c2-b411-e6e07fd88b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90b9a3b-952f-47d6-9cbc-7802118e4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd" returned: 0 in 0.566s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509204045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4736dd-cf82-438d-8f1e-118185b62077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:33Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Creating volume ec4736dd-cf82-438d-8f1e-118185b62077 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:35 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90b9a3b-952f-47d6-9cbc-7802118e4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2070847616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd1b16c-b883-4d5a-b334-6724d57a5eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:35Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a5b91d-5607-4088-9492-3d8f69627843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a5b91d-5607-4088-9492-3d8f69627843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2596f5-d9aa-46d2-a11f-27c5faecb16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 1073741824 Sep 25 16:28:35 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2596f5-d9aa-46d2-a11f-27c5faecb16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd1b16c-b883-4d5a-b334-6724d57a5eb9', 'volume_name': 'volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6467d728-ec24-4265-a534-cc44ce47d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6467d728-ec24-4265-a534-cc44ce47d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cff602-5ee7-4d07-a8db-3704a697a07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume 8cd1b16c-b883-4d5a-b334-6724d57a5eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9', 'volume_size': 1} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690b1c4c-d892-46f3-afc1-b15192974f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00018271-7173-45f9-85d2-d51a3443c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:35 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd (29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd): created successfully Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00018271-7173-45f9-85d2-d51a3443c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (04826ca3-917a-4c91-9164-962cf95eb014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:35 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.414s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:35 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Deleted volume successfully. Sep 25 16:28:35 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e901d57c-15dd-4939-8035-2e0571ad3838 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created volume successfully. Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-3a486ea9-00fb-4414-a158-323b883cf7c0 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-40d62b70-3ce8-47e1-b718-5dba467d9984-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-06fb66e3-38ef-4b7f-8c40-acfe67effa5e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-06fb66e3-38ef-4b7f-8c40-acfe67effa5e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-quobyte-06fb66e3-38ef-4b7f-8c40-acfe67effa5e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-06fb66e3-38ef-4b7f-8c40-acfe67effa5e" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea199d6-6e50-43de-8cfd-64d2cbd23881]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:35 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e Sep 25 16:28:35 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:35 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 1073741824" returned: 0 in 0.707s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:35 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 Sep 25 16:28:35 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:36 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e" returned: 0 in 0.587s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:36 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e Sep 25 16:28:36 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:36 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077" returned: 0 in 0.408s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028743742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7690d9e4-1756-4649-96bc-e579125aec72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:34Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Creating volume 7690d9e4-1756-4649-96bc-e579125aec72 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:36 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c45c2aa-9ab4-48df-87c7-425631bd294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4736dd-cf82-438d-8f1e-118185b62077', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:36 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 1073741824 Sep 25 16:28:36 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1518be41-258e-43e6-b95f-f4fdf9b3ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:36 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume volume-ec4736dd-cf82-438d-8f1e-118185b62077 (ec4736dd-cf82-438d-8f1e-118185b62077): created successfully Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1518be41-258e-43e6-b95f-f4fdf9b3ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (e4ba7c77-1b98-46ee-89c0-b857556831ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:36 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9a233b6c-08b4-46f1-bce1-a69de2f73a9e tempest-CreateVolumesFromSnapshotTest-988726382 None] Created volume successfully. Sep 25 16:28:36 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06fb66e3-38ef-4b7f-8c40-acfe67effa5e" returned: 0 in 0.413s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-06fb66e3-38ef-4b7f-8c40-acfe67effa5e" released by "delete_volume" :: held 1.076s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created reservations ['22f2cb37-446a-4ccc-9221-1392e87be43a', '9198ee57-46ac-4f8a-b85c-810045b49f5b', '3cb6cdb8-feb8-48be-b49d-8de92cb98e1f', 'f1cba662-02c0-4d36-bba5-ece1394f477d'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:36 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:36 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:36 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 1073741824" returned: 0 in 0.753s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:37 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 Sep 25 16:28:37 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:37 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.346s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Deleted volume successfully. Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-04f65e50-ea76-42f4-8bf0-20b12968ee52 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-06fb66e3-38ef-4b7f-8c40-acfe67effa5e-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:37 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72" returned: 0 in 0.326s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.247s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2070847616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd1b16c-b883-4d5a-b334-6724d57a5eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4050c372cdc49a9b0900dce70696d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:35Z,use_quota=True,user_id='15cb951dc2a74e1ba0dc722f19c83c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Creating volume 8cd1b16c-b883-4d5a-b334-6724d57a5eb9 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:37 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3243b2-dab2-4ef2-9c37-38b2a9bc032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7690d9e4-1756-4649-96bc-e579125aec72', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:37 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 1073741824 Sep 25 16:28:37 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98644fc4-3f0c-40ea-a674-df25d5c7a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:37 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume volume-7690d9e4-1756-4649-96bc-e579125aec72 (7690d9e4-1756-4649-96bc-e579125aec72): created successfully Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98644fc4-3f0c-40ea-a674-df25d5c7a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (5185437d-b87f-441c-a9b9-858d6f08681f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-670cb196-ff81-48a7-b939-abf43634d031 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created volume successfully. Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-d47f341f-2b78-413c-9339-4d1f440da34f-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-d47f341f-2b78-413c-9339-4d1f440da34f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-quobyte-d47f341f-2b78-413c-9339-4d1f440da34f" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-d47f341f-2b78-413c-9339-4d1f440da34f" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd07ce7-91c5-499c-912e-c7c662fe3e4b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:38 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f Sep 25 16:28:38 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 1073741824" returned: 0 in 0.736s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:38 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 Sep 25 16:28:38 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f" returned: 0 in 0.577s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:38 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9" returned: 0 in 0.362s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:38 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f Sep 25 16:28:38 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cff602-5ee7-4d07-a8db-3704a697a07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63f2b6d-8c3e-4dd6-9c85-37ffaabd44d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:38 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Volume volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 (8cd1b16c-b883-4d5a-b334-6724d57a5eb9): created successfully Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63f2b6d-8c3e-4dd6-9c85-37ffaabd44d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Flow 'volume_create_manager' (92126610-3bc9-47c2-b411-e6e07fd88b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:38 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-83cc575e-a8a1-4367-9302-f28bb27c0908 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created volume successfully. Sep 25 16:28:38 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d47f341f-2b78-413c-9339-4d1f440da34f" returned: 0 in 0.358s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-d47f341f-2b78-413c-9339-4d1f440da34f" released by "delete_volume" :: held 0.998s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:38 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created reservations ['99f19b1a-0d10-4518-8f28-269878552adc', 'af3aaf2a-cea8-4543-b6c5-c071621108fa', '736312ba-c879-454c-93be-692f39d6c3ba', '019b2b14-fbe9-40eb-b983-b394b913a64b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:39 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:39 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:39 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.322s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Deleted volume successfully. Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d232700a-061c-4354-a2ce-26b3968bef97 tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-d47f341f-2b78-413c-9339-4d1f440da34f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-8cd1b16c-b883-4d5a-b334-6724d57a5eb9-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-8cd1b16c-b883-4d5a-b334-6724d57a5eb9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-8cd1b16c-b883-4d5a-b334-6724d57a5eb9" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-8cd1b16c-b883-4d5a-b334-6724d57a5eb9" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eade76-5a56-4feb-874a-b036ec641c03]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:39 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 Sep 25 16:28:40 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-bb61a787-2e27-4b33-9f9d-a7c7e549ded1-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-bb61a787-2e27-4b33-9f9d-a7c7e549ded1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "cinder-quobyte-bb61a787-2e27-4b33-9f9d-a7c7e549ded1" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-bb61a787-2e27-4b33-9f9d-a7c7e549ded1" acquired by "delete_volume" :: waited 0.038s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[61027bc0-b5b3-4164-a468-c460895c361b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:40 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9" returned: 0 in 0.639s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:40 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9 Sep 25 16:28:40 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:40 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 Sep 25 16:28:40 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:40 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-8cd1b16c-b883-4d5a-b334-6724d57a5eb9" returned: 0 in 0.327s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-8cd1b16c-b883-4d5a-b334-6724d57a5eb9" released by "delete_volume" :: held 1.051s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:40 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created reservations ['46bc641a-938e-496f-a318-56e3f2d7cbef', '75e434a3-d6f0-4c4a-a2b2-285c0fd1db0a', '72b886ea-6c9e-400d-99bc-36ee15e57efe', '613c20ef-d1e8-403d-b595-8d3131ab82de'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:41 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1" returned: 0 in 0.701s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:41 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:41 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:41 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1 Sep 25 16:28:41 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:41 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.401s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Deleted volume successfully. Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cd60c420-b2de-442e-b56f-c4a97daee019 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-8cd1b16c-b883-4d5a-b334-6724d57a5eb9-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:41 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-bb61a787-2e27-4b33-9f9d-a7c7e549ded1" returned: 0 in 0.452s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-quobyte-bb61a787-2e27-4b33-9f9d-a7c7e549ded1" released by "delete_volume" :: held 1.228s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Created reservations ['37c4bace-e935-4f22-9a05-be89f968a0aa', '5a6902bf-dc0b-4fcb-8f09-5f076ab9f562', '80b3aced-2b7d-4538-87bd-3f4692b655bc', 'd93e2c44-56be-4974-b36b-e9b8894f76f1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:41 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:41 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-7690d9e4-1756-4649-96bc-e579125aec72-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-7690d9e4-1756-4649-96bc-e579125aec72-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:42 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.560s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-7690d9e4-1756-4649-96bc-e579125aec72" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Deleted volume successfully. Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-7690d9e4-1756-4649-96bc-e579125aec72" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-937c9f38-217b-4e0f-ba8a-ea1af9da1bcc tempest-CreateVolumesFromSourceVolumeTest-401829491 None] Lock "cinder-bb61a787-2e27-4b33-9f9d-a7c7e549ded1-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a52d9-8aa5-4508-a6c8-281e2baf5e2e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:42 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 Sep 25 16:28:42 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:43 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72" returned: 0 in 0.698s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:43 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72 Sep 25 16:28:43 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:43 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-7690d9e4-1756-4649-96bc-e579125aec72" returned: 0 in 0.604s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:43 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-7690d9e4-1756-4649-96bc-e579125aec72" released by "delete_volume" :: held 1.397s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:43 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=143,cinder:UPDATE=202,cinder:INSERT=57,cinder:DELETE=19 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:28:43 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=153,cinder:UPDATE=204,cinder:INSERT=53,cinder:DELETE=20 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:28:43 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created reservations ['942c7267-49f9-44a2-b46a-a8711b3e2209', 'd28861e5-b57b-4967-a696-629947357299', '14780051-4d0b-4d05-b9b8-43cc908952c6', '05a97c58-fe43-4bef-baba-be3c0f7ed111'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:44 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:44 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:44 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.345s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Deleted volume successfully. Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d61e8434-a68a-4b1f-8965-26a361b28e21 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-7690d9e4-1756-4649-96bc-e579125aec72-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-ec4736dd-cf82-438d-8f1e-118185b62077-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-ec4736dd-cf82-438d-8f1e-118185b62077-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-ec4736dd-cf82-438d-8f1e-118185b62077" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-ec4736dd-cf82-438d-8f1e-118185b62077" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eaf542-6259-47ec-97ee-6749c2f4db2d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:45 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 Sep 25 16:28:45 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:45 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077" returned: 0 in 0.581s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:45 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077 Sep 25 16:28:45 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:45 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ec4736dd-cf82-438d-8f1e-118185b62077" returned: 0 in 0.409s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:45 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-ec4736dd-cf82-438d-8f1e-118185b62077" released by "delete_volume" :: held 1.066s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:45 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created reservations ['93847a66-0a26-42ad-8775-94c3fa1060f9', '97f38bff-8d41-42b1-8734-b02533e34159', '081a9d28-7999-49c0-a0a3-60589699737f', '750daa61-5cc1-4c27-8080-f3fd6b4ecc44'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:46 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:46 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:46 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.433s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Deleted volume successfully. Sep 25 16:28:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-41214270-df28-488c-b606-fce72b1a0d24 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-ec4736dd-cf82-438d-8f1e-118185b62077-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:47 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec1c270-be77-4d8a-b34e-415f16296f4e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:47 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd Sep 25 16:28:47 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd" returned: 0 in 0.742s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd Sep 25 16:28:48 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Flow 'volume_create_manager' (d501f436-6bca-41d8-b69b-11c5ccdc2caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6deaa92a-1a7e-4e20-acb9-b61e941b5051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6deaa92a-1a7e-4e20-acb9-b61e941b5051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1194489637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b363eb-7238-4f6d-8a86-0b188c225b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb93c92b40b1430e9fa384ff199b2006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:48Z,use_quota=True,user_id='3b96309c53cb4691ab8a33038fd0c5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb6a476-201c-4bda-8e5e-60356ae4f9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb6a476-201c-4bda-8e5e-60356ae4f9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b294b884-ffac-4715-a490-8b3eb2d416cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b294b884-ffac-4715-a490-8b3eb2d416cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b363eb-7238-4f6d-8a86-0b188c225b1e', 'volume_name': 'volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769964f1-faf3-45a8-b9d6-c2857e782cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769964f1-faf3-45a8-b9d6-c2857e782cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319ebab4-4087-4410-930b-acffbdc03114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Volume c1b363eb-7238-4f6d-8a86-0b188c225b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e', 'volume_size': 1} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1194489637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b363eb-7238-4f6d-8a86-0b188c225b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb93c92b40b1430e9fa384ff199b2006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:48Z,use_quota=True,user_id='3b96309c53cb4691ab8a33038fd0c5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Creating volume c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:48 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd" returned: 0 in 0.442s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:48 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e 1073741824 Sep 25 16:28:48 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd" released by "delete_volume" :: held 1.296s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created reservations ['192a6e82-0d0b-4b83-9f8a-c0dae8ca4b5b', '46b59f1c-4434-4506-b632-daeefac3107c', '997dd05c-d4aa-4c09-bef7-a0160e0e2b99', 'e747d8bf-6479-4937-a1fd-d01a753d6397'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:48 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:48 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:49 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Deleted volume successfully. Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-0d91d4d6-4059-4bfd-99cb-ffc85b97bba1 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-29c3d62c-a4d8-4462-a6a2-f2293cd4d2dd-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:49 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e 1073741824" returned: 0 in 0.782s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:49 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e Sep 25 16:28:49 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-71ffb702-06dd-4f2f-bae0-fa58e48759b9-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-71ffb702-06dd-4f2f-bae0-fa58e48759b9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-71ffb702-06dd-4f2f-bae0-fa58e48759b9" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-71ffb702-06dd-4f2f-bae0-fa58e48759b9" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4d984-1a8c-4978-80a3-aa9482ab65ee]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:49 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e" returned: 0 in 0.426s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319ebab4-4087-4410-930b-acffbdc03114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6ff79a-b54d-4ccf-aa46-526831c882cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Volume volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e (c1b363eb-7238-4f6d-8a86-0b188c225b1e): created successfully Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6ff79a-b54d-4ccf-aa46-526831c882cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Flow 'volume_create_manager' (d501f436-6bca-41d8-b69b-11c5ccdc2caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7d82ae82-f135-451d-94c8-78b7c40df1df tempest-SnapshotDependencyTests-200557789 None] Created volume successfully. Sep 25 16:28:49 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 Sep 25 16:28:49 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:50 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9" returned: 0 in 0.570s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:50 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9 Sep 25 16:28:50 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:50 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-71ffb702-06dd-4f2f-bae0-fa58e48759b9" returned: 0 in 0.415s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-71ffb702-06dd-4f2f-bae0-fa58e48759b9" released by "delete_volume" :: held 1.078s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Flow 'volume_create_manager' (7d2f2705-0cbc-487b-a6d6-6c0e1a02ddd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad759d7-d234-4556-89e9-6a81440421b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad759d7-d234-4556-89e9-6a81440421b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1975353686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939b4d10-b479-41c5-bd8b-80ff6648b2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc40721fa64a7081519a6e777dc216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:51Z,use_quota=True,user_id='e54f37789f9e48ef9bbb08d8eb655b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccbf649-2073-4957-8cb2-2debe644ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccbf649-2073-4957-8cb2-2debe644ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb40dd7-5f8d-450a-bb85-8530af8d1497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb40dd7-5f8d-450a-bb85-8530af8d1497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939b4d10-b479-41c5-bd8b-80ff6648b2ea', 'volume_name': 'volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6429840b-82ba-4887-a17b-f291b57d3191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6429840b-82ba-4887-a17b-f291b57d3191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f586c289-f8fb-4932-b375-18f61219cb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:50 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Volume 939b4d10-b479-41c5-bd8b-80ff6648b2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea', 'volume_size': 1} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1975353686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939b4d10-b479-41c5-bd8b-80ff6648b2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc40721fa64a7081519a6e777dc216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:51Z,use_quota=True,user_id='e54f37789f9e48ef9bbb08d8eb655b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Creating volume 939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:50 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:50 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea 1073741824 Sep 25 16:28:50 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:50 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created reservations ['12018c4c-cf61-4151-b5af-0423bc8200d2', 'f8b4b78f-5f07-43c3-8886-b656658e12da', '0e9fc983-728b-4886-837f-4ef087ce51b0', '00d3d63f-c9bc-4119-91c4-80b8f65e2776'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:51 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:51 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.330s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Deleted volume successfully. Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-896e245c-783d-4ecd-b8dc-67127b632d17 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-71ffb702-06dd-4f2f-bae0-fa58e48759b9-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:51 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea 1073741824" returned: 0 in 0.600s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea Sep 25 16:28:51 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-e51d379c-fb0b-4d48-83ae-2e708dc18662-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-e51d379c-fb0b-4d48-83ae-2e708dc18662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-44afc280-1b80-4f41-889c-63c17cd6a71b" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-44afc280-1b80-4f41-889c-63c17cd6a71b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-e51d379c-fb0b-4d48-83ae-2e708dc18662" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:51 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea" returned: 0 in 0.355s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-e51d379c-fb0b-4d48-83ae-2e708dc18662" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Deleting offline snapshot e51d379c-fb0b-4d48-83ae-2e708dc18662 of volume 44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] snapshot_file for this snap is: volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f586c289-f8fb-4932-b375-18f61219cb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dd4db9-4955-4ee7-b5b3-1e979fbfeb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f780d1-b2af-4937-ac70-d1b5b4ed6f1e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Creating offline snapshot 080b5413-70ed-4ff2-b50a-a69693cbaf9d of volume c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Volume volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea (939b4d10-b479-41c5-bd8b-80ff6648b2ea): created successfully Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dd4db9-4955-4ee7-b5b3-1e979fbfeb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Flow 'volume_create_manager' (7d2f2705-0cbc-487b-a6d6-6c0e1a02ddd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[89309d87-1469-4343-8dd1-f4476f82520f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-49a656d2-337d-484f-bef5-3bb4f4d1a44d tempest-VolumeDependencyTests-756570367 None] Created volume successfully. Sep 25 16:28:52 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 Sep 25 16:28:52 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e Sep 25 16:28:52 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662" returned: 0 in 0.488s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44afc280-1b80-4f41-889c-63c17cd6a71b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[551bda8f-eac3-458e-bbcb-13a2895dcf28]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e" returned: 0 in 0.522s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:52 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d 1G Sep 25 16:28:52 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:52 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b Sep 25 16:28:52 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b" returned: 0 in 0.660s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:53 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 Sep 25 16:28:53 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d 1G" returned: 0 in 0.732s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:53 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d Sep 25 16:28:53 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d" returned: 0 in 0.403s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:53 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d is being set with open permissions: ugo+rw Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:53 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662" returned: 0 in 0.549s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:53 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d Sep 25 16:28:53 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662 Sep 25 16:28:53 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (78d8a53a-ad40-4922-addc-aa235cd62d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d160f814-1214-4689-8ded-397fb7f668fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d160f814-1214-4689-8ded-397fb7f668fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855591036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12452e15-eeb9-4e11-98a1-9fdfec639398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:54Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ce0758-e7c0-4b4b-b724-368c174fceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ce0758-e7c0-4b4b-b724-368c174fceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29bcd2e-0003-4b6b-975d-973c3e88545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29bcd2e-0003-4b6b-975d-973c3e88545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12452e15-eeb9-4e11-98a1-9fdfec639398', 'volume_name': 'volume-12452e15-eeb9-4e11-98a1-9fdfec639398', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db95c7b-a4f0-4d5b-a856-1ea1a7fd3825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db95c7b-a4f0-4d5b-a856-1ea1a7fd3825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32bffde-e780-4fa8-be29-07734a618896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Volume 12452e15-eeb9-4e11-98a1-9fdfec639398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12452e15-eeb9-4e11-98a1-9fdfec639398', 'volume_size': 1} Sep 25 16:28:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:53 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d" returned: 0 in 0.317s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:54 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b.e51d379c-fb0b-4d48-83ae-2e708dc18662" returned: 0 in 0.343s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:54 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.info Sep 25 16:28:54 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-e51d379c-fb0b-4d48-83ae-2e708dc18662" released by "_delete_snapshot" :: held 2.213s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-44afc280-1b80-4f41-889c-63c17cd6a71b" released by "delete_snapshot" :: held 2.241s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Created reservations ['a72c6096-549e-4d17-b10c-b17e83858409', 'bfe7694c-0f70-48f4-876c-d679b322db81', '9125ea17-5a79-4647-a870-094d259d7071', 'd009f4d7-73a2-4afc-9e4c-154a40810aed'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Delete snapshot completed successfully. Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-51558d09-613b-47c5-ac42-fc6f694203ab tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-e51d379c-fb0b-4d48-83ae-2e708dc18662-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:54 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.info" returned: 0 in 0.327s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:54 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.info is being set with open permissions: ugo+rw Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:54 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.info Sep 25 16:28:54 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:54 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.info" returned: 0 in 0.278s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.455s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Creating offline snapshot ab163f2e-d309-45d9-bd03-f006e73d8670 of volume 939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:28:54 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-65e460b2-6c90-458a-8346-41f8bfbe6185 tempest-SnapshotDependencyTests-200557789 None] Create snapshot completed successfully Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b4032-b9f0-47ca-bdad-2b50740b06ea]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:54 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea Sep 25 16:28:54 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:55 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea" returned: 0 in 0.409s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:55 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 1G Sep 25 16:28:55 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-44afc280-1b80-4f41-889c-63c17cd6a71b-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-44afc280-1b80-4f41-889c-63c17cd6a71b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "cinder-quobyte-44afc280-1b80-4f41-889c-63c17cd6a71b" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-44afc280-1b80-4f41-889c-63c17cd6a71b" acquired by "delete_volume" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cfc7f9-cfb5-4b2b-94dd-718b9d6db87b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:55 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b Sep 25 16:28:55 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:55 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 1G" returned: 0 in 0.613s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:55 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 Sep 25 16:28:55 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:56 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:56 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b Sep 25 16:28:56 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:56 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670" returned: 0 in 0.464s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:56 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 is being set with open permissions: ugo+rw Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:56 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 Sep 25 16:28:56 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:56 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Flow 'volume_create_manager' (91bcca29-51c0-4dd4-a265-60cd1f078b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d2fb90-9b75-4c5f-9111-805da2927b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-44afc280-1b80-4f41-889c-63c17cd6a71b" returned: 0 in 0.353s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d2fb90-9b75-4c5f-9111-805da2927b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af406309-b261-4718-b98a-02ac5138829e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb93c92b40b1430e9fa384ff199b2006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=080b5413-70ed-4ff2-b50a-a69693cbaf9d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:56Z,use_quota=True,user_id='3b96309c53cb4691ab8a33038fd0c5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f01b56-0816-4058-805c-469e91f33831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f01b56-0816-4058-805c-469e91f33831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f322e-5447-467b-8bfe-584fb3fdec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f322e-5447-467b-8bfe-584fb3fdec1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af406309-b261-4718-b98a-02ac5138829e', 'volume_name': 'volume-af406309-b261-4718-b98a-02ac5138829e', 'volume_size': 1, 'snapshot_id': '080b5413-70ed-4ff2-b50a-a69693cbaf9d'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2349d03-c012-4ae7-b967-21542c027034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2349d03-c012-4ae7-b967-21542c027034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f592b4ce-5af3-4d11-81d9-2ff8a8d54736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Volume af406309-b261-4718-b98a-02ac5138829e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af406309-b261-4718-b98a-02ac5138829e', 'volume_size': 1, 'snapshot_id': '080b5413-70ed-4ff2-b50a-a69693cbaf9d'} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-quobyte-44afc280-1b80-4f41-889c-63c17cd6a71b" released by "delete_volume" :: held 0.976s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:56 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670" returned: 0 in 0.293s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Created reservations ['775171a8-d05d-4052-9fe5-7aea33796c78', 'e0f976e9-d529-45f2-a5f2-898845058989', '61c2b1ec-55d5-4a0b-bd3b-56b8d6203a32', '606d9797-033b-4c47-9001-46e8c82064ce'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:56 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.info Sep 25 16:28:56 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:56 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:28:56 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:56 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.info" returned: 0 in 0.291s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:56 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.info is being set with open permissions: ugo+rw Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:56 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.info Sep 25 16:28:56 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:56 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.301s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:28:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Deleted volume successfully. Sep 25 16:28:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-99ce3f24-90a3-4434-9a85-765d345de3e5 tempest-CreateVolumesFromSnapshotTest-988726382 None] Lock "cinder-44afc280-1b80-4f41-889c-63c17cd6a71b-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:28:57 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.info" returned: 0 in 0.301s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.315s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855591036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12452e15-eeb9-4e11-98a1-9fdfec639398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:54Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Creating volume 12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:57 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:57 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 1073741824 Sep 25 16:28:57 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-06b48e93-acd8-45ac-995b-e85f0808d1de tempest-VolumeDependencyTests-756570367 None] Create snapshot completed successfully Sep 25 16:28:57 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 1073741824" returned: 0 in 0.522s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:57 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 Sep 25 16:28:57 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:58 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398" returned: 0 in 0.358s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.649s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-quobyte-080b5413-70ed-4ff2-b50a-a69693cbaf9d-af406309-b261-4718-b98a-02ac5138829e" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32bffde-e780-4fa8-be29-07734a618896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12452e15-eeb9-4e11-98a1-9fdfec639398', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c72142-4759-41b3-b664-5bb31410dfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-080b5413-70ed-4ff2-b50a-a69693cbaf9d-af406309-b261-4718-b98a-02ac5138829e" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Creating volume af406309-b261-4718-b98a-02ac5138829e from snapshot 080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-quobyte-af406309-b261-4718-b98a-02ac5138829e" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:28:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Volume volume-12452e15-eeb9-4e11-98a1-9fdfec639398 (12452e15-eeb9-4e11-98a1-9fdfec639398): created successfully Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c72142-4759-41b3-b664-5bb31410dfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (78d8a53a-ad40-4922-addc-aa235cd62d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-eef7604d-3bb3-4460-914c-7c3edfbe84c3 tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-af406309-b261-4718-b98a-02ac5138829e" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] snapshot: 080b5413-70ed-4ff2-b50a-a69693cbaf9d, volume: af406309-b261-4718-b98a-02ac5138829e, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Flow 'volume_create_manager' (b3294e47-3c75-4939-b794-19a8131dd0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f7e652-f935-4588-b20b-0ac5725c2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed46c791-3871-4b22-ad8d-47ff5b9536c9]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f7e652-f935-4588-b20b-0ac5725c2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1611545268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d90fbd-3647-4ad5-bd13-dcbb87bd5265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcc40721fa64a7081519a6e777dc216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab163f2e-d309-45d9-bd03-f006e73d8670,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:28:58Z,use_quota=True,user_id='e54f37789f9e48ef9bbb08d8eb655b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cae4711-f2d2-49ae-b67f-19eb0ec29344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cae4711-f2d2-49ae-b67f-19eb0ec29344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2443fd44-8672-4969-9dae-0f77603fe08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2443fd44-8672-4969-9dae-0f77603fe08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5d90fbd-3647-4ad5-bd13-dcbb87bd5265', 'volume_name': 'volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265', 'volume_size': 1, 'snapshot_id': 'ab163f2e-d309-45d9-bd03-f006e73d8670'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5d8e8e-1919-4bdb-b804-ad0dab0ccb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5d8e8e-1919-4bdb-b804-ad0dab0ccb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e5d66-9753-4e9a-bd04-c3127b0e2598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:28:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Volume f5d90fbd-3647-4ad5-bd13-dcbb87bd5265: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265', 'volume_size': 1, 'snapshot_id': 'ab163f2e-d309-45d9-bd03-f006e73d8670'} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:28:58 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d Sep 25 16:28:58 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:58 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d" returned: 0 in 0.456s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c5d4e-cf7b-4482-aba1-1fba367aea62]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:28:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:58 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e Sep 25 16:28:58 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:59 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 25 16:28:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e" returned: 0 in 0.460s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:28:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:28:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:28:59 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:28:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:28:59 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e Sep 25 16:28:59 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:28:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:03 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-84dd17e0-36dc-40c6-a92b-d1747699210e tempest-ProjectAdminTests-1197561987 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3218307495117, 'free_capacity_gb': 1775.3218307495117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87467) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 16:29:07 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e" returned: 0 in 7.867s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:29:07 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Converted 1024.00 MB image at 130.14 MB/s Sep 25 16:29:07 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e is being set with open permissions: ugo+rw Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:07 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e Sep 25 16:29:07 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:07 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e" returned: 0 in 0.282s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-af406309-b261-4718-b98a-02ac5138829e" released by "_copy_volume_from_snapshot" :: held 9.223s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-080b5413-70ed-4ff2-b50a-a69693cbaf9d-af406309-b261-4718-b98a-02ac5138829e" released by "_create_volume_from_snapshot" :: held 9.344s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.394s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.075s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-quobyte-ab163f2e-d309-45d9-bd03-f006e73d8670-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" by "_create_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-ab163f2e-d309-45d9-bd03-f006e73d8670-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Creating volume f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 from snapshot ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-quobyte-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" by "_copy_volume_from_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f592b4ce-5af3-4d11-81d9-2ff8a8d54736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af406309-b261-4718-b98a-02ac5138829e', 'volume_size': 1, 'snapshot_id': '080b5413-70ed-4ff2-b50a-a69693cbaf9d'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f67433-ae80-48cb-80a9-24f4a42dff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] snapshot: ab163f2e-d309-45d9-bd03-f006e73d8670, volume: f5d90fbd-3647-4ad5-bd13-dcbb87bd5265, {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:07 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Volume volume-af406309-b261-4718-b98a-02ac5138829e (af406309-b261-4718-b98a-02ac5138829e): created successfully Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f67433-ae80-48cb-80a9-24f4a42dff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Flow 'volume_create_manager' (91bcca29-51c0-4dd4-a265-60cd1f078b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b230ed93-4800-4b80-aee1-b3322239f554]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:07 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4a2c8767-2fc5-4a47-9855-5e8a55edc226 tempest-SnapshotDependencyTests-200557789 None] Created volume successfully. Sep 25 16:29:07 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 Sep 25 16:29:07 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:08 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670" returned: 0 in 0.426s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18b803b-8b42-4bec-92d0-bf2fe6e8af56]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:08 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea Sep 25 16:29:08 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-080b5413-70ed-4ff2-b50a-a69693cbaf9d-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-080b5413-70ed-4ff2-b50a-a69693cbaf9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-quobyte-c1b363eb-7238-4f6d-8a86-0b188c225b1e" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-c1b363eb-7238-4f6d-8a86-0b188c225b1e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-quobyte-080b5413-70ed-4ff2-b50a-a69693cbaf9d" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-080b5413-70ed-4ff2-b50a-a69693cbaf9d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Deleting offline snapshot 080b5413-70ed-4ff2-b50a-a69693cbaf9d of volume c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] snapshot_file for this snap is: volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[1057cbb1-9a3a-44e4-adfe-13a091d1a85a]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:08 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea" returned: 0 in 0.496s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Creating direct copy from snapshot {{(pid=87467) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG cinder.utils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Path /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 not found in is_blk_device check {{(pid=87467) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 16:29:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:08 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 Sep 25 16:29:08 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:08 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d Sep 25 16:29:08 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:09 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d" returned: 0 in 0.470s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:09 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83486c9-4971-4281-8c9f-3b2983cec224]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:09 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e Sep 25 16:29:09 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (7a761623-2ac8-4953-a980-48587ce5a460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a716c7cb-81ea-4550-aa75-4aef11bf9fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a716c7cb-81ea-4550-aa75-4aef11bf9fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072251289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cdbd0f-d572-4930-ba44-2d494fc12145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:10Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb8e407-fc20-4c21-b77a-7f8e05f39ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:10 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb8e407-fc20-4c21-b77a-7f8e05f39ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19759c10-552f-4c65-bd49-9feac6a404c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19759c10-552f-4c65-bd49-9feac6a404c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cdbd0f-d572-4930-ba44-2d494fc12145', 'volume_name': 'volume-c6cdbd0f-d572-4930-ba44-2d494fc12145', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24369dc-4224-4b0f-8c33-3f3547b3149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24369dc-4224-4b0f-8c33-3f3547b3149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc8bbac-236c-40f7-98b8-b50eaba62acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:10 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Volume c6cdbd0f-d572-4930-ba44-2d494fc12145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cdbd0f-d572-4930-ba44-2d494fc12145', 'volume_size': 1} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e" returned: 0 in 1.210s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:10 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d Sep 25 16:29:10 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d" returned: 0 in 0.727s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:11 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d Sep 25 16:29:11 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:11 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e.080b5413-70ed-4ff2-b50a-a69693cbaf9d" returned: 0 in 0.443s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-080b5413-70ed-4ff2-b50a-a69693cbaf9d" released by "_delete_snapshot" :: held 3.065s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-c1b363eb-7238-4f6d-8a86-0b188c225b1e" released by "delete_snapshot" :: held 3.099s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:11 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Created reservations ['311367c9-1d99-4ecb-a3c8-8a1500fe2778', '71ca339d-a2e4-4d3c-87e6-e97e1264ff66', '262df5ba-4fcb-425c-9b4f-53ce827e1a45', '75cd3e41-4bfb-40f4-9162-b42e1e78a3fc'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Delete snapshot completed successfully. Sep 25 16:29:11 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-5492c271-b5fe-4b22-b03e-dc553f9fc90b tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-080b5413-70ed-4ff2-b50a-a69693cbaf9d-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-c1b363eb-7238-4f6d-8a86-0b188c225b1e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-c1b363eb-7238-4f6d-8a86-0b188c225b1e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-quobyte-c1b363eb-7238-4f6d-8a86-0b188c225b1e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:13 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-c1b363eb-7238-4f6d-8a86-0b188c225b1e" acquired by "delete_volume" :: waited 0.035s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:13 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb98cdd-ce37-4919-bdce-0b3f07aeeb82]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:13 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e Sep 25 16:29:13 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:13 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e" returned: 0 in 0.735s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:13 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e Sep 25 16:29:13 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:14 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c1b363eb-7238-4f6d-8a86-0b188c225b1e" returned: 0 in 0.441s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-c1b363eb-7238-4f6d-8a86-0b188c225b1e" released by "delete_volume" :: held 1.322s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Created reservations ['a0fbaefa-35a7-4c15-ae5e-a70d04eb492f', 'ff72f967-3d76-483c-b680-fd32d8c7c22a', '314369ed-e055-4030-bef1-ebe2948f1c43', '1e5b0684-6ae4-4cc5-9f38-695863b7218a'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:14 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:14 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:15 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.468s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:15 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Deleted volume successfully. Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-447b3f0e-c2fd-4551-80f3-9e930e751591 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-c1b363eb-7238-4f6d-8a86-0b188c225b1e-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-af406309-b261-4718-b98a-02ac5138829e-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-af406309-b261-4718-b98a-02ac5138829e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "cinder-quobyte-af406309-b261-4718-b98a-02ac5138829e" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:15 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:15 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-af406309-b261-4718-b98a-02ac5138829e" acquired by "delete_volume" :: waited 0.042s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc37e98-f6db-43a2-a06c-deb020ec891c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:15 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e Sep 25 16:29:15 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:16 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.574s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:29:16 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e" returned: 0 in 0.677s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:16 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e Sep 25 16:29:16 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:16 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-af406309-b261-4718-b98a-02ac5138829e" returned: 0 in 0.462s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-quobyte-af406309-b261-4718-b98a-02ac5138829e" released by "delete_volume" :: held 1.238s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Created reservations ['16f31b8a-8bc2-489a-a32a-21b6deb9fba5', '862df1ba-6275-4c5a-a7f5-77fd22e7cb0e', '60eb7e85-6d44-4b8b-9804-f1658b43876d', 'ca620afb-725e-4dab-a085-c8c8ff655209'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:16 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" returned: 0 in 8.260s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG cinder.image.image_utils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Image conversion details: src /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 {{(pid=87467) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 16:29:16 devstack cinder-volume[87467]: INFO cinder.image.image_utils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Converted 1024.00 MB image at 123.95 MB/s Sep 25 16:29:16 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 is being set with open permissions: ugo+rw Sep 25 16:29:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:16 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 Sep 25 16:29:16 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:17 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:17 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:17 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" returned: 0 in 0.285s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" released by "_copy_volume_from_snapshot" :: held 9.598s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-ab163f2e-d309-45d9-bd03-f006e73d8670-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" released by "_create_volume_from_snapshot" :: held 9.781s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.812s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.711s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:17 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.284s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot 760a4356-3a73-47cb-a145-a95fb2fd8841 of volume 12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Deleted volume successfully. Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c946732-dd47-47e2-a828-2f0c2cbb3a8c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e5d66-9753-4e9a-bd04-c3127b0e2598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265', 'volume_size': 1, 'snapshot_id': 'ab163f2e-d309-45d9-bd03-f006e73d8670'}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc8c193-0af6-407e-a764-cff83b981292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec63c1a2-1bf2-474e-a863-bb41ce5208c6 tempest-SnapshotDependencyTests-200557789 None] Lock "cinder-af406309-b261-4718-b98a-02ac5138829e-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Volume volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 (f5d90fbd-3647-4ad5-bd13-dcbb87bd5265): created successfully Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc8c193-0af6-407e-a764-cff83b981292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Flow 'volume_create_manager' (b3294e47-3c75-4939-b794-19a8131dd0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:17 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 Sep 25 16:29:17 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b6f06541-3c63-4be1-89c7-8d105006a1a7 tempest-VolumeDependencyTests-756570367 None] Created volume successfully. Sep 25 16:29:17 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:17 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 1G Sep 25 16:29:17 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-ab163f2e-d309-45d9-bd03-f006e73d8670-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-ab163f2e-d309-45d9-bd03-f006e73d8670-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-quobyte-939b4d10-b479-41c5-bd8b-80ff6648b2ea" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-939b4d10-b479-41c5-bd8b-80ff6648b2ea" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-quobyte-ab163f2e-d309-45d9-bd03-f006e73d8670" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-ab163f2e-d309-45d9-bd03-f006e73d8670" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Deleting offline snapshot ab163f2e-d309-45d9-bd03-f006e73d8670 of volume 939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:18 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] snapshot_file for this snap is: volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 1G" returned: 0 in 0.508s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12452e15-eeb9-4e11-98a1-9fdfec639398 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8004de7-2965-48b6-af80-1a852e58184b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:18 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12452e15-eeb9-4e11-98a1-9fdfec639398 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 Sep 25 16:29:18 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:18 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 Sep 25 16:29:18 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:18 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12452e15-eeb9-4e11-98a1-9fdfec639398 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841" returned: 0 in 0.414s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:18 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 is being set with open permissions: ugo+rw Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:18 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 Sep 25 16:29:18 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:18 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670" returned: 0 in 0.487s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2676b17-5087-472f-b4eb-72eed52af097]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:19 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea Sep 25 16:29:19 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:19 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841" returned: 0 in 0.335s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:19 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.info Sep 25 16:29:19 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:19 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.info" returned: 0 in 0.280s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:19 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.info is being set with open permissions: ugo+rw Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:19 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.info Sep 25 16:29:19 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:19 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea" returned: 0 in 0.646s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:19 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 Sep 25 16:29:19 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:19 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.info" returned: 0 in 0.309s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.461s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072251289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cdbd0f-d572-4930-ba44-2d494fc12145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:10Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Creating volume c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:19 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:19 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 1073741824 Sep 25 16:29:19 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:19 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-066141b1-b0ff-4308-b56c-5b0d425b4ec9 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:29:20 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670" returned: 0 in 0.488s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:20 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670 Sep 25 16:29:20 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:20 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 1073741824" returned: 0 in 0.573s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea.ab163f2e-d309-45d9-bd03-f006e73d8670" returned: 0 in 0.347s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-ab163f2e-d309-45d9-bd03-f006e73d8670" released by "_delete_snapshot" :: held 2.110s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-939b4d10-b479-41c5-bd8b-80ff6648b2ea" released by "delete_snapshot" :: held 2.141s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:20 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 Sep 25 16:29:20 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Created reservations ['acf054fd-1e29-41be-9c64-6ba816d9ce59', 'a9293696-14f6-4fce-82f7-9e5288c410f7', 'd2d0ff56-ba4d-417c-9d87-120840da1ba0', 'bf77e7fa-21b2-4221-80b2-04634c4e23d2'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:20 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145" returned: 0 in 0.281s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc8bbac-236c-40f7-98b8-b50eaba62acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cdbd0f-d572-4930-ba44-2d494fc12145', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faafa1a-4ab5-4f7e-86c2-1ef48db120a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Delete snapshot completed successfully. Sep 25 16:29:20 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-fdac77e0-73a1-45f9-9a22-c9f63870a929 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-ab163f2e-d309-45d9-bd03-f006e73d8670-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:20 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Volume volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 (c6cdbd0f-d572-4930-ba44-2d494fc12145): created successfully Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faafa1a-4ab5-4f7e-86c2-1ef48db120a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (7a761623-2ac8-4953-a980-48587ce5a460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-760a4356-3a73-47cb-a145-a95fb2fd8841-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Lock "cinder-760a4356-3a73-47cb-a145-a95fb2fd8841-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-12452e15-eeb9-4e11-98a1-9fdfec639398" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-12452e15-eeb9-4e11-98a1-9fdfec639398" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-760a4356-3a73-47cb-a145-a95fb2fd8841" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-760a4356-3a73-47cb-a145-a95fb2fd8841" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot 760a4356-3a73-47cb-a145-a95fb2fd8841 of volume 12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:21 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7205f038-ba08-49fa-86bb-bc8815a12eb2 tempest-ProjectReaderTests-1864031062 None] Created volume successfully. Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f179f-ffdb-447e-9c7b-03a92adf0733]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:21 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 Sep 25 16:29:21 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:21 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841" returned: 0 in 0.423s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12452e15-eeb9-4e11-98a1-9fdfec639398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75cec7f-1577-47c0-9c82-7ffbd86984a8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-939b4d10-b479-41c5-bd8b-80ff6648b2ea-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:21 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 Sep 25 16:29:21 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-939b4d10-b479-41c5-bd8b-80ff6648b2ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-quobyte-939b4d10-b479-41c5-bd8b-80ff6648b2ea" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-939b4d10-b479-41c5-bd8b-80ff6648b2ea" acquired by "delete_volume" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:22 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398" returned: 0 in 0.439s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd536e83-cc4a-417a-9745-3981d82c10fe]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:22 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 Sep 25 16:29:22 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:22 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea Sep 25 16:29:22 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:22 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841" returned: 0 in 0.426s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:22 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841 Sep 25 16:29:22 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:22 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea" returned: 0 in 0.475s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:22 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea Sep 25 16:29:22 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:22 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398.760a4356-3a73-47cb-a145-a95fb2fd8841" returned: 0 in 0.302s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-760a4356-3a73-47cb-a145-a95fb2fd8841" released by "_delete_snapshot" :: held 1.745s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-12452e15-eeb9-4e11-98a1-9fdfec639398" released by "delete_snapshot" :: held 1.808s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:22 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-939b4d10-b479-41c5-bd8b-80ff6648b2ea" returned: 0 in 0.384s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Creating offline snapshot 751e55b9-dda5-4fbc-8762-148e626772fa of volume c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-939b4d10-b479-41c5-bd8b-80ff6648b2ea" released by "delete_volume" :: held 0.985s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb780aa-6da3-495b-9c2f-a49b8540633e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 Sep 25 16:29:23 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Created reservations ['a7366fae-cb86-4bc9-a221-aa91f2500083', '8e05a6e2-3ee6-45ce-8213-3f45c1ce7e7c', 'fa714e9d-c616-494d-ae1c-70d92c448bb0', '7b1f6524-7b8f-48e3-88f4-e5938e8f026c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Created reservations ['d115a70e-5245-4b5a-a153-00a6d5ebca77', '6427055a-f3df-44dd-8604-c0bdb3a9701a', '2b4c006a-431a-4f51-87b6-14d638e88a0a', 'a35f7f89-be76-43f5-bba3-1e6ef7065712'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:23 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145" returned: 0 in 0.411s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa 1G Sep 25 16:29:23 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-934046d6-adbb-4ab1-81fb-69571f9501dd tempest-ProjectMemberTests-1709475716 None] Lock "cinder-760a4356-3a73-47cb-a145-a95fb2fd8841-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:23 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa 1G" returned: 0 in 0.474s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:23 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa Sep 25 16:29:23 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:23 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.322s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:23 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Deleted volume successfully. Sep 25 16:29:24 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa" returned: 0 in 0.361s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:24 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa is being set with open permissions: ugo+rw Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:24 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa Sep 25 16:29:24 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-642819c6-ca0c-4a96-97ef-81bdd4619089 tempest-VolumeDependencyTests-756570367 None] Lock "cinder-939b4d10-b479-41c5-bd8b-80ff6648b2ea-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Lock "cinder-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:24 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-12452e15-eeb9-4e11-98a1-9fdfec639398-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa" returned: 0 in 0.301s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-12452e15-eeb9-4e11-98a1-9fdfec639398-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Acquiring lock "cinder-quobyte-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:24 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.info Sep 25 16:29:24 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" acquired by "delete_volume" :: waited 0.055s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-12452e15-eeb9-4e11-98a1-9fdfec639398" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-12452e15-eeb9-4e11-98a1-9fdfec639398" acquired by "delete_volume" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b31cd-668e-4501-a670-98987735da05]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0b8ed0-8af7-45e6-93ee-215983163ca3]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:25 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 Sep 25 16:29:25 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:25 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 Sep 25 16:29:25 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:25 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.info" returned: 0 in 0.355s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:25 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.info is being set with open permissions: ugo+rw Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:25 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.info Sep 25 16:29:25 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:25 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398" returned: 0 in 0.479s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" returned: 0 in 0.515s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:25 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398 Sep 25 16:29:25 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.info" returned: 0 in 0.331s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:25 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265 Sep 25 16:29:25 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-950263a8-7139-41da-bf2c-3afdeb96cfca tempest-ProjectReaderTests-1864031062 None] Create snapshot completed successfully Sep 25 16:29:25 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-12452e15-eeb9-4e11-98a1-9fdfec639398" returned: 0 in 0.405s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-12452e15-eeb9-4e11-98a1-9fdfec639398" released by "delete_volume" :: held 0.959s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:25 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" returned: 0 in 0.410s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Lock "cinder-quobyte-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265" released by "delete_volume" :: held 1.059s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Created reservations ['539299a4-a147-4b28-a4d4-7371b29c4f3d', '249be5fd-4b3b-4e61-88df-990a7581796f', '572c6b4d-bf29-4976-a756-c8e53669677a', '2b987d89-0781-4a9c-83ab-a1ca1db6694a'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:25 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Created reservations ['a586380a-0d49-4827-859f-d77d51c679f7', '1ee5287e-dcac-459d-b141-6bc6c5fa5581', '0a5f6791-11da-4dab-ba29-546a5e5b1a1d', '7065e3c3-21ed-41c0-b486-2373401b70eb'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:26 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:26 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:26 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:26 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-751e55b9-dda5-4fbc-8762-148e626772fa-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-751e55b9-dda5-4fbc-8762-148e626772fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-c6cdbd0f-d572-4930-ba44-2d494fc12145" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-c6cdbd0f-d572-4930-ba44-2d494fc12145" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-751e55b9-dda5-4fbc-8762-148e626772fa" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-751e55b9-dda5-4fbc-8762-148e626772fa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Deleting offline snapshot 751e55b9-dda5-4fbc-8762-148e626772fa of volume c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:26 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] snapshot_file for this snap is: volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.363s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00525e3-b96d-463e-b85e-b566003c9567]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ef10865d-f65e-4e24-8bd4-c02a676cdfa3 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-12452e15-eeb9-4e11-98a1-9fdfec639398-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:26 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.385s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Deleted volume successfully. Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1589f4a5-8c6a-433d-861e-2b001ac814ec tempest-VolumeDependencyTests-756570367 None] Lock "cinder-f5d90fbd-3647-4ad5-bd13-dcbb87bd5265-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:26 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa Sep 25 16:29:26 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:26 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa" returned: 0 in 0.529s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6cdbd0f-d572-4930-ba44-2d494fc12145(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53384e9-0dae-4f9c-b427-a296508da0d5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:27 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 Sep 25 16:29:27 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:27 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (a9e79e47-3d32-497a-8616-5d6e57f4494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ea6fd0-412d-4553-82cc-a81eab63aa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145" returned: 0 in 0.600s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ea6fd0-412d-4553-82cc-a81eab63aa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677564834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487c3113-0a19-4f86-a5d4-3e8e84284da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:27Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:27 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1f59f8-b38d-4f0c-b865-e61466f81fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:27 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1f59f8-b38d-4f0c-b865-e61466f81fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27ac218-2243-4088-9ae3-7c1e0eb7496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27ac218-2243-4088-9ae3-7c1e0eb7496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487c3113-0a19-4f86-a5d4-3e8e84284da5', 'volume_name': 'volume-487c3113-0a19-4f86-a5d4-3e8e84284da5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c22d62-0d98-4a72-8b8e-070fff181067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c22d62-0d98-4a72-8b8e-070fff181067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736f589e-552d-4db9-9cb8-b6773bd4af5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Volume 487c3113-0a19-4f86-a5d4-3e8e84284da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487c3113-0a19-4f86-a5d4-3e8e84284da5', 'volume_size': 1} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677564834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487c3113-0a19-4f86-a5d4-3e8e84284da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:27Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Creating volume 487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:27 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:27 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 1073741824 Sep 25 16:29:27 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:28 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa" returned: 0 in 0.560s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:28 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa Sep 25 16:29:28 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:28 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 1073741824" returned: 0 in 0.738s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:28 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:28 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145.751e55b9-dda5-4fbc-8762-148e626772fa" returned: 0 in 0.377s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:28 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-751e55b9-dda5-4fbc-8762-148e626772fa" released by "_delete_snapshot" :: held 2.231s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-c6cdbd0f-d572-4930-ba44-2d494fc12145" released by "delete_snapshot" :: held 2.270s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Created reservations ['45317196-8b71-446c-a019-2ed29241fc72', 'e0fcbfb5-59aa-4c69-a0b4-d19f8a61efdf', '75691573-7e53-4a7b-81fb-f90a1e0c3fb3', 'ba2c0654-ed58-4678-9ff1-ec86e2035fc0'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:28 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Delete snapshot completed successfully. Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8eb604e5-6fe2-4379-bc47-7ba32bb415e6 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-751e55b9-dda5-4fbc-8762-148e626772fa-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:28 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5" returned: 0 in 0.419s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736f589e-552d-4db9-9cb8-b6773bd4af5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487c3113-0a19-4f86-a5d4-3e8e84284da5', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:28 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcf32d0-1962-4e96-9c15-27916f0b69fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:29 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Volume volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 (487c3113-0a19-4f86-a5d4-3e8e84284da5): created successfully Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcf32d0-1962-4e96-9c15-27916f0b69fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (a9e79e47-3d32-497a-8616-5d6e57f4494a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-327cc6d1-b011-4065-b825-e1aec03b01d2 tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-c6cdbd0f-d572-4930-ba44-2d494fc12145-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-c6cdbd0f-d572-4930-ba44-2d494fc12145-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-c6cdbd0f-d572-4930-ba44-2d494fc12145" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-c6cdbd0f-d572-4930-ba44-2d494fc12145" acquired by "delete_volume" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd179f-0aad-4dd3-8104-d6c556d82f14]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:29 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 Sep 25 16:29:29 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot abfb3274-47a2-4171-a455-b58161770e6e of volume 487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe14e2-c877-4e87-8121-42857d6a7670]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:30 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 Sep 25 16:29:30 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:30 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145" returned: 0 in 0.492s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:30 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145 Sep 25 16:29:30 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:30 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5" returned: 0 in 0.621s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:30 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:30 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e 1G Sep 25 16:29:30 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-c6cdbd0f-d572-4930-ba44-2d494fc12145" returned: 0 in 0.424s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-c6cdbd0f-d572-4930-ba44-2d494fc12145" released by "delete_volume" :: held 1.024s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Created reservations ['316b89e4-eb8c-46a4-a3d9-2f29a019337d', '61074bde-d2ee-4b59-ab1e-52eac7160e16', 'c20f7dda-0221-4bfb-8530-8805e505b4d7', 'c7ceae50-0965-4337-b22d-00fd0f5167db'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:31 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:31 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:31 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e 1G" returned: 0 in 0.682s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:31 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e Sep 25 16:29:31 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:31 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.346s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:31 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:31 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Deleted volume successfully. Sep 25 16:29:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-54b47d9e-6aa3-4840-820f-761061cde235 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-c6cdbd0f-d572-4930-ba44-2d494fc12145-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:31 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:31 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e is being set with open permissions: ugo+rw Sep 25 16:29:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:31 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e Sep 25 16:29:31 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:32 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e" returned: 0 in 0.466s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:32 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.info Sep 25 16:29:32 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:32 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.info" returned: 0 in 0.451s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:32 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.info is being set with open permissions: ugo+rw Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:32 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.info Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:32 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (01816605-5d6f-4426-86c6-0d92c5cc6773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edd40c5-15df-4e27-bf9c-5b6da8997411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edd40c5-15df-4e27-bf9c-5b6da8997411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd89b70a-b544-4b61-915c-7deae9f69442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:33Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ed23ed-0d62-4c1a-a9ef-73d81c0ac9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ed23ed-0d62-4c1a-a9ef-73d81c0ac9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df90b680-3a9d-4685-a665-ce3bec17f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df90b680-3a9d-4685-a665-ce3bec17f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd89b70a-b544-4b61-915c-7deae9f69442', 'volume_name': 'volume-cd89b70a-b544-4b61-915c-7deae9f69442', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50c9b21-8e8d-4f80-8982-02312f97954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50c9b21-8e8d-4f80-8982-02312f97954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282ce142-59bc-4a2a-b67d-1ed67c81f65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:32 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Volume cd89b70a-b544-4b61-915c-7deae9f69442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd89b70a-b544-4b61-915c-7deae9f69442', 'volume_size': 1} Sep 25 16:29:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:33 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.info" returned: 0 in 0.372s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.218s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd89b70a-b544-4b61-915c-7deae9f69442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:33Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Creating volume cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:33 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:33 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 1073741824 Sep 25 16:29:33 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-a8038323-79b2-40ad-ab02-7e52039e8db5 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-abfb3274-47a2-4171-a455-b58161770e6e-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-abfb3274-47a2-4171-a455-b58161770e6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-487c3113-0a19-4f86-a5d4-3e8e84284da5" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-487c3113-0a19-4f86-a5d4-3e8e84284da5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-abfb3274-47a2-4171-a455-b58161770e6e" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-abfb3274-47a2-4171-a455-b58161770e6e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot abfb3274-47a2-4171-a455-b58161770e6e of volume 487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a2294-553b-4126-928f-d601fa393701]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:33 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 1073741824" returned: 0 in 0.617s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:33 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e Sep 25 16:29:33 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:33 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 Sep 25 16:29:33 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:34 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442" returned: 0 in 0.380s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282ce142-59bc-4a2a-b67d-1ed67c81f65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd89b70a-b544-4b61-915c-7deae9f69442', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01070549-d14d-4cc3-a819-6208cf807cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:34 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Volume volume-cd89b70a-b544-4b61-915c-7deae9f69442 (cd89b70a-b544-4b61-915c-7deae9f69442): created successfully Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01070549-d14d-4cc3-a819-6208cf807cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:34 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (01816605-5d6f-4426-86c6-0d92c5cc6773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e" returned: 0 in 0.572s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-487c3113-0a19-4f86-a5d4-3e8e84284da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8a547e45-f837-4dad-9b90-01f3888dd24a tempest-ProjectReaderTests-1864031062 None] Created volume successfully. Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[52769625-d704-47b8-9148-b8441b35230d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:34 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 Sep 25 16:29:34 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:34 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5" returned: 0 in 0.578s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:34 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e Sep 25 16:29:34 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Creating offline snapshot 96d616b9-1398-4505-8a0f-86a1567666d6 of volume cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad585b3-a165-45d6-bdbe-23f58b73ae19]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:35 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 Sep 25 16:29:35 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:35 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e" returned: 0 in 0.508s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:35 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e Sep 25 16:29:35 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:35 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442" returned: 0 in 0.449s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:35 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 1G Sep 25 16:29:35 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:35 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5.abfb3274-47a2-4171-a455-b58161770e6e" returned: 0 in 0.271s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-abfb3274-47a2-4171-a455-b58161770e6e" released by "_delete_snapshot" :: held 2.097s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-487c3113-0a19-4f86-a5d4-3e8e84284da5" released by "delete_snapshot" :: held 2.126s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Created reservations ['0fd7369e-c02c-4643-93a4-6a91f1dc8e00', '507d123b-41c6-4f18-8e2d-7bdeedbcc084', '9f7a1d30-0702-4384-b1f2-c16e338b473d', '27054253-5ebb-4968-9d03-0be957314a83'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:35 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:29:35 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b4ffc3e4-119d-49e3-8292-8f0f7bcf27d8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-abfb3274-47a2-4171-a455-b58161770e6e-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:36 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 1G" returned: 0 in 0.467s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd89b70a-b544-4b61-915c-7deae9f69442 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:36 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd89b70a-b544-4b61-915c-7deae9f69442 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 Sep 25 16:29:36 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:36 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd89b70a-b544-4b61-915c-7deae9f69442 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6" returned: 0 in 0.320s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:36 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 is being set with open permissions: ugo+rw Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:36 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 Sep 25 16:29:36 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:36 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6" returned: 0 in 0.282s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:36 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.info Sep 25 16:29:36 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-487c3113-0a19-4f86-a5d4-3e8e84284da5-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Lock "cinder-487c3113-0a19-4f86-a5d4-3e8e84284da5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-487c3113-0a19-4f86-a5d4-3e8e84284da5" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:36 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-487c3113-0a19-4f86-a5d4-3e8e84284da5" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:37 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.info" returned: 0 in 0.366s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:37 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.info is being set with open permissions: ugo+rw Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[788cbc1b-e44e-4515-9433-a86df3738c75]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:37 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.info Sep 25 16:29:37 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:37 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 Sep 25 16:29:37 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:37 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.info" returned: 0 in 0.304s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:37 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4f22d3ef-e351-4936-b7c8-b007fa1039a7 tempest-ProjectReaderTests-1864031062 None] Create snapshot completed successfully Sep 25 16:29:37 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5" returned: 0 in 0.450s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:37 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5 Sep 25 16:29:37 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:37 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-487c3113-0a19-4f86-a5d4-3e8e84284da5" returned: 0 in 0.264s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-487c3113-0a19-4f86-a5d4-3e8e84284da5" released by "delete_volume" :: held 0.800s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Created reservations ['3858d201-43d5-404a-a305-a8c127c7384b', 'a2533573-f6b6-4113-821c-5cd8c97f5770', '80b5be01-a6ce-4d0b-9341-068c19dbb01e', 'd3d8ec2b-9422-423f-bff1-3450ea5c860d'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:37 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:37 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:38 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.277s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:38 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-96d616b9-1398-4505-8a0f-86a1567666d6-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ac838dc8-3a1a-439f-bc3b-29a1449d51ba tempest-ProjectMemberTests-1709475716 None] Lock "cinder-487c3113-0a19-4f86-a5d4-3e8e84284da5-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Lock "cinder-96d616b9-1398-4505-8a0f-86a1567666d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-cd89b70a-b544-4b61-915c-7deae9f69442" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-cd89b70a-b544-4b61-915c-7deae9f69442" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-96d616b9-1398-4505-8a0f-86a1567666d6" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-96d616b9-1398-4505-8a0f-86a1567666d6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Deleting offline snapshot 96d616b9-1398-4505-8a0f-86a1567666d6 of volume cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] snapshot_file for this snap is: volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[2067b0b5-434c-47bd-b695-bdebb47e1f91]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:38 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 Sep 25 16:29:38 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (832fd9eb-1873-4135-b4f4-2350e52bb602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a66921c-834b-45b5-ae30-588910c1a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a66921c-834b-45b5-ae30-588910c1a86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553373402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1317a309-7711-4103-bed3-a7ce79ce8871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:39Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3928e5e5-e95c-45cd-ac6a-21e3c838cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3928e5e5-e95c-45cd-ac6a-21e3c838cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46c716-d88a-4c0a-bf67-7f6ba70d8a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d46c716-d88a-4c0a-bf67-7f6ba70d8a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1317a309-7711-4103-bed3-a7ce79ce8871', 'volume_name': 'volume-1317a309-7711-4103-bed3-a7ce79ce8871', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b07075-5b81-41a6-bce5-8854c87ffe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b07075-5b81-41a6-bce5-8854c87ffe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0614e4c-ff71-4944-9888-c96ea5ae403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:38 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Volume 1317a309-7711-4103-bed3-a7ce79ce8871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1317a309-7711-4103-bed3-a7ce79ce8871', 'volume_size': 1} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553373402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1317a309-7711-4103-bed3-a7ce79ce8871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:39Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Creating volume 1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:38 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:38 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 1073741824 Sep 25 16:29:38 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:38 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6" returned: 0 in 0.576s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:38 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd89b70a-b544-4b61-915c-7deae9f69442(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c2012a-ddfc-46bf-b31e-98ed64b175f5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:39 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 Sep 25 16:29:39 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:39 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 1073741824" returned: 0 in 0.556s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:39 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442" returned: 0 in 0.418s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:39 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 Sep 25 16:29:39 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:39 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 Sep 25 16:29:39 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:39 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871" returned: 0 in 0.286s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0614e4c-ff71-4944-9888-c96ea5ae403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1317a309-7711-4103-bed3-a7ce79ce8871', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cfcb0c-4034-4340-89d1-eb8f27a66d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:39 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Volume volume-1317a309-7711-4103-bed3-a7ce79ce8871 (1317a309-7711-4103-bed3-a7ce79ce8871): created successfully Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cfcb0c-4034-4340-89d1-eb8f27a66d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (832fd9eb-1873-4135-b4f4-2350e52bb602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:39 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-dcfd0fbd-63c0-4352-9792-9e1a93ae1bfc tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:29:39 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6" returned: 0 in 0.386s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:39 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6 Sep 25 16:29:39 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:40 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442.96d616b9-1398-4505-8a0f-86a1567666d6" returned: 0 in 0.257s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-96d616b9-1398-4505-8a0f-86a1567666d6" released by "_delete_snapshot" :: held 1.783s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-cd89b70a-b544-4b61-915c-7deae9f69442" released by "delete_snapshot" :: held 1.811s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Created reservations ['e4e487e9-47fc-4969-a6c3-2b4a6d6ccb80', '82d095ff-27bc-49eb-b00c-8ac1ac052df8', '10986ee7-53ba-4834-a50f-302b560f77ac', '7e03d313-8440-4f17-8aad-7c9d70c8ea1d'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:40 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Delete snapshot completed successfully. Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d5f008b8-2b96-4bab-9332-88f64195028d tempest-ProjectReaderTests-1864031062 None] Lock "cinder-96d616b9-1398-4505-8a0f-86a1567666d6-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-cd89b70a-b544-4b61-915c-7deae9f69442-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Lock "cinder-cd89b70a-b544-4b61-915c-7deae9f69442-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-cd89b70a-b544-4b61-915c-7deae9f69442" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-cd89b70a-b544-4b61-915c-7deae9f69442" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c239f-a35f-4830-ae00-b7b7ba06a8fb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:40 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 Sep 25 16:29:40 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:40 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442" returned: 0 in 0.443s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot e99b3d85-c7df-4c37-bc33-37f008df3b51 of volume 1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:41 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442 Sep 25 16:29:41 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f05d5ff-e3a8-47d9-9da2-1cb72896fc3f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:41 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 Sep 25 16:29:41 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:41 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-cd89b70a-b544-4b61-915c-7deae9f69442" returned: 0 in 0.298s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-cd89b70a-b544-4b61-915c-7deae9f69442" released by "delete_volume" :: held 0.809s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Created reservations ['aac2379d-88a2-4836-aae6-b934b807b356', 'd70c76dc-046a-449c-a265-c5e300bfef7a', 'fde993aa-1915-4f3c-adad-3f5f70bbf0d5', '15e31fa9-f065-466a-8e79-830c747bec6f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:41 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871" returned: 0 in 0.430s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:41 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:41 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:41 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 1G Sep 25 16:29:41 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:41 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.300s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Deleted volume successfully. Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f64f6c2b-dfd0-407b-89bf-69094306e24b tempest-ProjectReaderTests-1864031062 None] Lock "cinder-cd89b70a-b544-4b61-915c-7deae9f69442-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:41 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 1G" returned: 0 in 0.489s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1317a309-7711-4103-bed3-a7ce79ce8871 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:42 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1317a309-7711-4103-bed3-a7ce79ce8871 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 Sep 25 16:29:42 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (d95132c3-7902-46fb-beb1-2f258898eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d09d6df-1c7b-466f-98fc-8aa549b19b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d09d6df-1c7b-466f-98fc-8aa549b19b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306591154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18947b95-6ce9-4331-a532-5adb68c5134b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:42Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0610f719-c733-44f9-89c2-62f15523c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0610f719-c733-44f9-89c2-62f15523c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cae9d8-23ae-4974-81b3-4ab250ea2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cae9d8-23ae-4974-81b3-4ab250ea2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18947b95-6ce9-4331-a532-5adb68c5134b', 'volume_name': 'volume-18947b95-6ce9-4331-a532-5adb68c5134b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06d9cde-7e64-4bd0-9283-4aba48a5295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06d9cde-7e64-4bd0-9283-4aba48a5295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d9feb1-d32a-46c1-ab62-8c1674544667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:42 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Volume 18947b95-6ce9-4331-a532-5adb68c5134b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18947b95-6ce9-4331-a532-5adb68c5134b', 'volume_size': 1} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:42 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1317a309-7711-4103-bed3-a7ce79ce8871 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51" returned: 0 in 0.344s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:42 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 is being set with open permissions: ugo+rw Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:42 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 Sep 25 16:29:42 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:42 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51" returned: 0 in 0.246s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:42 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.info Sep 25 16:29:42 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:42 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.info" returned: 0 in 0.271s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:42 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.info is being set with open permissions: ugo+rw Sep 25 16:29:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:42 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.info Sep 25 16:29:42 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:43 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.info" returned: 0 in 0.291s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306591154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18947b95-6ce9-4331-a532-5adb68c5134b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:42Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Creating volume 18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:43 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:43 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b 1073741824 Sep 25 16:29:43 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:43 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9a4b95a0-50bd-46c0-8988-0ed0cbfa3c9d tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:29:43 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b 1073741824" returned: 0 in 0.458s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:43 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b Sep 25 16:29:43 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:43 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b" returned: 0 in 0.269s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=132,cinder:INSERT=48,cinder:UPDATE=187,cinder:DELETE=16 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d9feb1-d32a-46c1-ab62-8c1674544667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18947b95-6ce9-4331-a532-5adb68c5134b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648227d1-50b5-4ed9-aed8-6d259a3149a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=155,cinder:INSERT=49,cinder:UPDATE=178,cinder:DELETE=13 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:29:43 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Volume volume-18947b95-6ce9-4331-a532-5adb68c5134b (18947b95-6ce9-4331-a532-5adb68c5134b): created successfully Sep 25 16:29:43 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648227d1-50b5-4ed9-aed8-6d259a3149a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (d95132c3-7902-46fb-beb1-2f258898eaac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:44 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3d5a9760-178a-468e-9d36-881826329aa5 tempest-ProjectReaderTests-1864031062 None] Created volume successfully. Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-e99b3d85-c7df-4c37-bc33-37f008df3b51-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Lock "cinder-e99b3d85-c7df-4c37-bc33-37f008df3b51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-1317a309-7711-4103-bed3-a7ce79ce8871" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-1317a309-7711-4103-bed3-a7ce79ce8871" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-e99b3d85-c7df-4c37-bc33-37f008df3b51" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-e99b3d85-c7df-4c37-bc33-37f008df3b51" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot e99b3d85-c7df-4c37-bc33-37f008df3b51 of volume 1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f769763b-6f80-4318-b8be-22b859583e5c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:44 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 Sep 25 16:29:44 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Creating offline snapshot bd2a7460-bca8-40ee-bcb0-d5ded0228d2b of volume 18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[23123c12-69c8-4778-8435-e6a081d75cf5]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:44 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b Sep 25 16:29:44 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:44 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51" returned: 0 in 0.482s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1317a309-7711-4103-bed3-a7ce79ce8871(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4811664b-81c6-42b6-a50d-6a706f53520b]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:44 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 Sep 25 16:29:45 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b" returned: 0 in 0.456s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b 1G Sep 25 16:29:45 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871" returned: 0 in 0.460s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 Sep 25 16:29:45 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b 1G" returned: 0 in 0.556s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18947b95-6ce9-4331-a532-5adb68c5134b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18947b95-6ce9-4331-a532-5adb68c5134b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b Sep 25 16:29:45 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51" returned: 0 in 0.431s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51 Sep 25 16:29:45 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:45 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18947b95-6ce9-4331-a532-5adb68c5134b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" returned: 0 in 0.385s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:45 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b is being set with open permissions: ugo+rw Sep 25 16:29:45 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:45 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b Sep 25 16:29:45 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871.e99b3d85-c7df-4c37-bc33-37f008df3b51" returned: 0 in 0.325s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-e99b3d85-c7df-4c37-bc33-37f008df3b51" released by "_delete_snapshot" :: held 1.839s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-1317a309-7711-4103-bed3-a7ce79ce8871" released by "delete_snapshot" :: held 1.866s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Created reservations ['37bf27bb-d406-4ce0-af2e-65d98e10942b', '494c8b7b-7ebf-4744-9a9e-223f6aab5f9d', '48003d27-8837-4321-b306-7a5ae2c2dad5', 'c362a8d6-1b61-49ef-8404-43098f205a04'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:46 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" returned: 0 in 0.286s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-f2653150-ac92-4e85-8131-b9f074411aab tempest-ProjectMemberTests-1709475716 None] Lock "cinder-e99b3d85-c7df-4c37-bc33-37f008df3b51-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:46 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.info Sep 25 16:29:46 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-1317a309-7711-4103-bed3-a7ce79ce8871-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-1317a309-7711-4103-bed3-a7ce79ce8871-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-1317a309-7711-4103-bed3-a7ce79ce8871" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-1317a309-7711-4103-bed3-a7ce79ce8871" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45d92a-4348-4ef8-8ca6-78464d7ce558]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.info" returned: 0 in 0.310s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.info is being set with open permissions: ugo+rw Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:46 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.info Sep 25 16:29:46 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 Sep 25 16:29:46 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:46 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.info" returned: 0 in 0.332s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:46 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871" returned: 0 in 0.465s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:46 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-829fb9c1-2484-4402-9093-ed4d498669f4 tempest-ProjectReaderTests-1864031062 None] Create snapshot completed successfully Sep 25 16:29:47 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871 Sep 25 16:29:47 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-1317a309-7711-4103-bed3-a7ce79ce8871" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-1317a309-7711-4103-bed3-a7ce79ce8871" released by "delete_volume" :: held 0.863s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Created reservations ['af5e2f31-f21f-47ce-a8e3-c5302b1df0a2', '0cebee10-0455-4717-a039-e413b4fd54cd', '75a81b4f-3a23-4a7e-a613-01f67ff8d34c', 'b489a7b9-4e5b-4ed1-b40d-a9815024625b'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:47 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:47 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-bd2a7460-bca8-40ee-bcb0-d5ded0228d2b-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Lock "cinder-bd2a7460-bca8-40ee-bcb0-d5ded0228d2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-18947b95-6ce9-4331-a532-5adb68c5134b" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:47 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.329s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-18947b95-6ce9-4331-a532-5adb68c5134b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:47 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Deleting offline snapshot bd2a7460-bca8-40ee-bcb0-d5ded0228d2b of volume 18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] snapshot_file for this snap is: volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ebcda2af-1406-4255-9f51-88890a8f0436 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-1317a309-7711-4103-bed3-a7ce79ce8871-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b1563f-ff96-4c08-ac2f-3fbe90018594]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:47 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b Sep 25 16:29:48 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (88a4e717-4996-46c1-892a-0b8b8672c7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51611751-c023-462b-bfba-5e764780e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51611751-c023-462b-bfba-5e764780e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155972128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:48Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb0b19f-38ea-4ea8-ad2c-4856ca02ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb0b19f-38ea-4ea8-ad2c-4856ca02ce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de7d6d-7d15-4198-ba5b-5096e7d7d5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de7d6d-7d15-4198-ba5b-5096e7d7d5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf', 'volume_name': 'volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a298a33e-6523-4da2-b210-37fc9d0f7da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a298a33e-6523-4da2-b210-37fc9d0f7da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad3f84c-e6ed-485c-adca-9b0c766f37b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:48 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Volume 5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf', 'volume_size': 1} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155972128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:48Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Creating volume 5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:48 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf 1073741824 Sep 25 16:29:48 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" returned: 0 in 0.442s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18947b95-6ce9-4331-a532-5adb68c5134b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7aad9c-8b35-4db6-981c-084acfa4579d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b Sep 25 16:29:48 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf 1073741824" returned: 0 in 0.542s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b" returned: 0 in 0.490s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b Sep 25 16:29:48 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:48 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:48 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf Sep 25 16:29:48 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" returned: 0 in 0.326s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:49 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" returned: 0 in 0.379s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad3f84c-e6ed-485c-adca-9b0c766f37b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:49 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8dea13-f7f5-46c4-8033-0dd78b35b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:49 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:49 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Volume volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf (5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf): created successfully Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8dea13-f7f5-46c4-8033-0dd78b35b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (88a4e717-4996-46c1-892a-0b8b8672c7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-5e03ee6f-cdad-4fc8-908e-2e807a8ddf36 tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:29:49 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b.bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" returned: 0 in 0.279s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-bd2a7460-bca8-40ee-bcb0-d5ded0228d2b" released by "_delete_snapshot" :: held 1.729s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-18947b95-6ce9-4331-a532-5adb68c5134b" released by "delete_snapshot" :: held 1.773s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Created reservations ['c86f0201-9da6-4612-a50f-e384c58a1db1', 'c3b2f7ec-6566-4701-bbb1-bb4238bc884b', '95d1fc67-52ef-4fd8-9b2d-91c781b1e2f4', '75abc85b-184c-408c-a142-f6e9dd42c06a'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:49 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Delete snapshot completed successfully. Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-c55e7060-98b5-40b6-aab6-96c5af8f18fd tempest-ProjectReaderTests-1864031062 None] Lock "cinder-bd2a7460-bca8-40ee-bcb0-d5ded0228d2b-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-18947b95-6ce9-4331-a532-5adb68c5134b-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:49 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Lock "cinder-18947b95-6ce9-4331-a532-5adb68c5134b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-18947b95-6ce9-4331-a532-5adb68c5134b" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-18947b95-6ce9-4331-a532-5adb68c5134b" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[369276a5-3085-4ecb-9f33-6a9631f34127]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b Sep 25 16:29:50 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot 19ceb055-de45-420f-b784-b4ec815faa59 of volume 5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ff36d0-214d-42e0-a775-e44f12d2b29f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b" returned: 0 in 0.428s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b Sep 25 16:29:50 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf Sep 25 16:29:50 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:50 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-18947b95-6ce9-4331-a532-5adb68c5134b" returned: 0 in 0.298s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-18947b95-6ce9-4331-a532-5adb68c5134b" released by "delete_volume" :: held 0.797s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Created reservations ['78146a41-8f8a-4920-8af1-f02714cf3a4b', '602c6568-06a9-46d1-bbe0-8c9ca0cdb8b9', '7f50c9f3-38b3-4120-8595-63e64fcc3435', '58e2777c-0300-49d8-8822-1731850b0272'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:50 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" returned: 0 in 0.470s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:50 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:50 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 1G Sep 25 16:29:50 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:51 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.316s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:51 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Deleted volume successfully. Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6a759893-5e84-4042-bfe6-00706eaf65ef tempest-ProjectReaderTests-1864031062 None] Lock "cinder-18947b95-6ce9-4331-a532-5adb68c5134b-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:51 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 1G" returned: 0 in 0.462s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 Sep 25 16:29:51 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:51 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (30190d65-1310-4eca-8921-a15d8e96d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55105fc-684c-4c2d-88d5-e14d65edc8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59" returned: 0 in 0.360s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:51 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 is being set with open permissions: ugo+rw Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:51 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55105fc-684c-4c2d-88d5-e14d65edc8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236178834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a642da-328a-41e9-9039-6670f439abbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:52Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:51 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732cc633-c705-4d93-b815-b183c734f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732cc633-c705-4d93-b815-b183c734f808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae401802-c262-4396-9283-5831e312874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae401802-c262-4396-9283-5831e312874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a642da-328a-41e9-9039-6670f439abbf', 'volume_name': 'volume-55a642da-328a-41e9-9039-6670f439abbf', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98642f99-e8c2-4ec0-bf04-0d35a48db6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98642f99-e8c2-4ec0-bf04-0d35a48db6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de2f04-a499-4011-9d0b-8b12da140dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:51 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Volume 55a642da-328a-41e9-9039-6670f439abbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a642da-328a-41e9-9039-6670f439abbf', 'volume_size': 1} Sep 25 16:29:51 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:52 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59" returned: 0 in 0.316s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.info Sep 25 16:29:52 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.info" returned: 0 in 0.283s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.info is being set with open permissions: ugo+rw Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.info Sep 25 16:29:52 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.info" returned: 0 in 0.313s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236178834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a642da-328a-41e9-9039-6670f439abbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:52Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Creating volume 55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:52 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:52 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:52 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf 1073741824 Sep 25 16:29:52 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:52 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8bb37035-833f-4e7f-91ad-0fc58b369a42 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:29:53 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf 1073741824" returned: 0 in 0.459s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf Sep 25 16:29:53 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:53 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf" returned: 0 in 0.312s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de2f04-a499-4011-9d0b-8b12da140dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a642da-328a-41e9-9039-6670f439abbf', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2705bef-32df-4285-8642-cb66f8df05e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:53 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Volume volume-55a642da-328a-41e9-9039-6670f439abbf (55a642da-328a-41e9-9039-6670f439abbf): created successfully Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2705bef-32df-4285-8642-cb66f8df05e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (30190d65-1310-4eca-8921-a15d8e96d22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-19ceb055-de45-420f-b784-b4ec815faa59-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:53 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e0696b48-f864-4ae1-b831-7cf99c1f7799 tempest-ProjectReaderTests-1864031062 None] Created volume successfully. Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Lock "cinder-19ceb055-de45-420f-b784-b4ec815faa59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-19ceb055-de45-420f-b784-b4ec815faa59" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-19ceb055-de45-420f-b784-b4ec815faa59" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot 19ceb055-de45-420f-b784-b4ec815faa59 of volume 5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c495dd5-7536-40ef-a36c-66fa5bb648d7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:53 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:53 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 Sep 25 16:29:53 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Creating offline snapshot b30eef24-8c05-465e-915d-fe7ff309114c of volume 55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e6859c-7839-4230-ae75-37a56f36a463]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59" returned: 0 in 0.418s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:54 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf Sep 25 16:29:54 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[6653c56d-d285-42fc-990d-3c10b5ec2055]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf Sep 25 16:29:54 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf" returned: 0 in 0.437s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c 1G Sep 25 16:29:54 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:54 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" returned: 0 in 0.451s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:54 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:54 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 Sep 25 16:29:54 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c 1G" returned: 0 in 0.503s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a642da-328a-41e9-9039-6670f439abbf -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a642da-328a-41e9-9039-6670f439abbf -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c Sep 25 16:29:55 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59 Sep 25 16:29:55 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55a642da-328a-41e9-9039-6670f439abbf -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c" returned: 0 in 0.338s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c is being set with open permissions: ugo+rw Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf.19ceb055-de45-420f-b784-b4ec815faa59" returned: 0 in 0.278s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c Sep 25 16:29:55 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-19ceb055-de45-420f-b784-b4ec815faa59" released by "_delete_snapshot" :: held 1.697s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" released by "delete_snapshot" :: held 1.725s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Created reservations ['7a27c961-a8d7-4a2f-be40-035a060a23c9', '7697b6c2-dfbe-47c8-9578-42fb24f6a70c', 'e0b3910e-0efc-4dc0-b2f2-7e59debaf6a7', '2cc0a560-76ea-4008-a676-652003fc31b1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:55 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-01d73151-f030-4e67-8e4f-29b5519ba9ed tempest-ProjectMemberTests-1709475716 None] Lock "cinder-19ceb055-de45-420f-b784-b4ec815faa59-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:55 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c" returned: 0 in 0.284s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:55 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.info Sep 25 16:29:55 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:55 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:56 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.info" returned: 0 in 0.331s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.info is being set with open permissions: ugo+rw Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2002bc-a275-4bae-8e59-cac6216119a1]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.info Sep 25 16:29:56 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf Sep 25 16:29:56 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.info" returned: 0 in 0.299s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3c81151b-7e25-463e-adef-c66bf2306597 tempest-ProjectReaderTests-1864031062 None] Create snapshot completed successfully Sep 25 16:29:56 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" returned: 0 in 0.413s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf Sep 25 16:29:56 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:56 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" returned: 0 in 0.297s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf" released by "delete_volume" :: held 0.777s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Created reservations ['f55a5adc-7fc1-4fd3-95e3-f6f78fa88f68', '4722e992-47aa-49b9-9fef-076323449fe1', 'cdd70438-3cf6-46f1-a7df-dcd55def1c54', '61fc4d7b-b214-4912-93d5-70ddbbd26333'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:56 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:29:56 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:57 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.309s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:29:57 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-bb424dc0-eca8-4613-a737-6562ed1d55f4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-5ce7973f-a94f-4ebd-b8b0-eeac78b1eebf-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-b30eef24-8c05-465e-915d-fe7ff309114c-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-b30eef24-8c05-465e-915d-fe7ff309114c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-55a642da-328a-41e9-9039-6670f439abbf" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-55a642da-328a-41e9-9039-6670f439abbf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-b30eef24-8c05-465e-915d-fe7ff309114c" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-b30eef24-8c05-465e-915d-fe7ff309114c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Deleting offline snapshot b30eef24-8c05-465e-915d-fe7ff309114c of volume 55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] snapshot_file for this snap is: volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5568e2-008f-4e38-a287-3603a330e4f2]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:57 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c Sep 25 16:29:57 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (e57e7ef6-d506-4321-88a6-aaceeb71cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e405acb9-4dfb-4309-ba55-ea88bc4cf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e405acb9-4dfb-4309-ba55-ea88bc4cf261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844365233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ae5f35-cc9b-4538-b669-c8310e6fad26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:58Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7424b0b4-4a7d-4d59-8aa6-0d69f14d3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7424b0b4-4a7d-4d59-8aa6-0d69f14d3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6108f1f0-ea83-405e-831e-375032f01e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6108f1f0-ea83-405e-831e-375032f01e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ae5f35-cc9b-4538-b669-c8310e6fad26', 'volume_name': 'volume-69ae5f35-cc9b-4538-b669-c8310e6fad26', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5f95ac-d10d-4843-8a47-5039be0298df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5f95ac-d10d-4843-8a47-5039be0298df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa53d021-5d84-4e1e-86d6-bb2bc73163c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:57 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Volume 69ae5f35-cc9b-4538-b669-c8310e6fad26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ae5f35-cc9b-4538-b669-c8310e6fad26', 'volume_size': 1} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844365233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ae5f35-cc9b-4538-b669-c8310e6fad26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:29:58Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Creating volume 69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:29:57 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:57 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 1073741824 Sep 25 16:29:57 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:57 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c" returned: 0 in 0.398s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55a642da-328a-41e9-9039-6670f439abbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[23329556-5753-42be-b95c-42e7475f98a8]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:57 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf Sep 25 16:29:57 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 1073741824" returned: 0 in 0.486s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:58 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf" returned: 0 in 0.389s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:58 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 Sep 25 16:29:58 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c Sep 25 16:29:58 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26" returned: 0 in 0.266s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa53d021-5d84-4e1e-86d6-bb2bc73163c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ae5f35-cc9b-4538-b669-c8310e6fad26', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0b7568-6dd0-4fb2-af04-fe57e912c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:29:58 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Volume volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 (69ae5f35-cc9b-4538-b669-c8310e6fad26): created successfully Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0b7568-6dd0-4fb2-af04-fe57e912c620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (e57e7ef6-d506-4321-88a6-aaceeb71cba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:29:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-cf288fb3-3805-479b-af19-3813018a0ee8 tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:29:58 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c" returned: 0 in 0.366s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:58 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c Sep 25 16:29:58 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:58 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf.b30eef24-8c05-465e-915d-fe7ff309114c" returned: 0 in 0.264s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-b30eef24-8c05-465e-915d-fe7ff309114c" released by "_delete_snapshot" :: held 1.550s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-55a642da-328a-41e9-9039-6670f439abbf" released by "delete_snapshot" :: held 1.579s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:58 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Created reservations ['f6a56b81-9fad-4f62-9991-5deb14337386', 'e4ff5050-659b-4b61-8ac8-47cd111a1f90', 'a33e8937-c68c-4d37-8b77-23916a6e9d4a', 'a2a35c9f-c7b6-4e3f-956b-3e4f81434c5c'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:29:59 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Delete snapshot completed successfully. Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-871ff15f-9041-4d69-b2cd-e98083d64200 tempest-ProjectReaderTests-1864031062 None] Lock "cinder-b30eef24-8c05-465e-915d-fe7ff309114c-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-55a642da-328a-41e9-9039-6670f439abbf-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Lock "cinder-55a642da-328a-41e9-9039-6670f439abbf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-55a642da-328a-41e9-9039-6670f439abbf" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-55a642da-328a-41e9-9039-6670f439abbf" acquired by "delete_volume" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[e510b5d4-ea68-4dba-9610-87879f199e06]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:59 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf Sep 25 16:29:59 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot e679c170-27df-4ce5-a231-6fac31d7bec4 of volume 69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a97f27-d05e-4bee-a773-50cccb7f771f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:29:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:29:59 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf" returned: 0 in 0.422s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:00 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 Sep 25 16:30:00 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf Sep 25 16:30:00 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:00 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:00 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-55a642da-328a-41e9-9039-6670f439abbf" returned: 0 in 0.251s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-55a642da-328a-41e9-9039-6670f439abbf" released by "delete_volume" :: held 0.745s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:00 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26" returned: 0 in 0.410s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Created reservations ['e1588397-1f1f-4b69-8110-211d0d5fbc27', '4a6fb108-f7b6-4d4c-9e60-60fcf8aabdac', '8926cfc9-368b-49f5-8e06-2719437029c7', 'd0332440-56bd-460c-b5d2-4dfe75b33d46'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:00 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 1G Sep 25 16:30:00 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:00 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:00 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:00 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.270s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Deleted volume successfully. Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ae750b43-8c9c-4475-b0da-ce082ff9072f tempest-ProjectReaderTests-1864031062 None] Lock "cinder-55a642da-328a-41e9-9039-6670f439abbf-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:00 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 1G" returned: 0 in 0.479s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:00 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 Sep 25 16:30:00 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:01 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (08c60285-c5da-43f8-ad81-e82aead64ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b834acf0-d31c-4db8-b2cd-95ad864d523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4" returned: 0 in 0.379s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:01 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 is being set with open permissions: ugo+rw Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b834acf0-d31c-4db8-b2cd-95ad864d523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002609196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f3d363-62cd-4668-a705-a479c2d25bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:01Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:01 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 Sep 25 16:30:01 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b593aac4-91aa-4cd6-a671-1f6ecf1056ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b593aac4-91aa-4cd6-a671-1f6ecf1056ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7af29e7-4f75-4b2a-aeef-57bdf7d9517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7af29e7-4f75-4b2a-aeef-57bdf7d9517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f3d363-62cd-4668-a705-a479c2d25bc6', 'volume_name': 'volume-06f3d363-62cd-4668-a705-a479c2d25bc6', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a663f5-f66d-477a-8f25-55cf3da4752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a663f5-f66d-477a-8f25-55cf3da4752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527c8cce-2922-4237-903a-c56498d59db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:01 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Volume 06f3d363-62cd-4668-a705-a479c2d25bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f3d363-62cd-4668-a705-a479c2d25bc6', 'volume_size': 1} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:01 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4" returned: 0 in 0.234s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:01 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.info Sep 25 16:30:01 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:01 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.info" returned: 0 in 0.243s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:01 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.info is being set with open permissions: ugo+rw Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:01 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.info Sep 25 16:30:01 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:01 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.info" returned: 0 in 0.247s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002609196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f3d363-62cd-4668-a705-a479c2d25bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995d8ee824b416eb8bb0806298d7260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:01Z,use_quota=True,user_id='d956e602b628444a81834ac1eada9aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Creating volume 06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:01 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:01 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 1073741824 Sep 25 16:30:01 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-603a0700-ac15-4ecb-b4fd-436d4c321bf8 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:30:02 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 1073741824" returned: 0 in 0.440s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:02 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 Sep 25 16:30:02 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:02 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6" returned: 0 in 0.253s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527c8cce-2922-4237-903a-c56498d59db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f3d363-62cd-4668-a705-a479c2d25bc6', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7da6b3f-fe2e-4a23-a93c-88c57a4e7da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:02 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Volume volume-06f3d363-62cd-4668-a705-a479c2d25bc6 (06f3d363-62cd-4668-a705-a479c2d25bc6): created successfully Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7da6b3f-fe2e-4a23-a93c-88c57a4e7da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Flow 'volume_create_manager' (08c60285-c5da-43f8-ad81-e82aead64ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:02 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-7c385cc4-c9bd-4143-8131-2978401b86b4 tempest-ProjectReaderTests-1864031062 None] Created volume successfully. Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-e679c170-27df-4ce5-a231-6fac31d7bec4-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-e679c170-27df-4ce5-a231-6fac31d7bec4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-69ae5f35-cc9b-4538-b669-c8310e6fad26" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-69ae5f35-cc9b-4538-b669-c8310e6fad26" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-e679c170-27df-4ce5-a231-6fac31d7bec4" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-e679c170-27df-4ce5-a231-6fac31d7bec4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot e679c170-27df-4ce5-a231-6fac31d7bec4 of volume 69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e11d72-4057-448c-82e7-014daa6dd9ca]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:03 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 Sep 25 16:30:03 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Creating offline snapshot 78940230-0e76-4245-b9d1-0d1f7b3a1ea2 of volume 06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[345a874c-4de1-483f-bba3-6e98053420f0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:03 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 Sep 25 16:30:03 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:03 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4" returned: 0 in 0.463s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69ae5f35-cc9b-4538-b669-c8310e6fad26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e22ed-a52f-4791-b023-a83b7b1b2239]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:03 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 Sep 25 16:30:03 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:03 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6" returned: 0 in 0.434s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:03 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 1G Sep 25 16:30:03 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:04 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26" returned: 0 in 0.420s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:04 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 Sep 25 16:30:04 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:04 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 1G" returned: 0 in 0.476s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f3d363-62cd-4668-a705-a479c2d25bc6 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:04 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f3d363-62cd-4668-a705-a479c2d25bc6 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 Sep 25 16:30:04 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:04 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4" returned: 0 in 0.387s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:04 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4 Sep 25 16:30:04 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:04 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26.e679c170-27df-4ce5-a231-6fac31d7bec4" returned: 0 in 0.273s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:04 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f3d363-62cd-4668-a705-a479c2d25bc6 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2" returned: 0 in 0.386s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:04 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 is being set with open permissions: ugo+rw Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-e679c170-27df-4ce5-a231-6fac31d7bec4" released by "_delete_snapshot" :: held 1.680s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-69ae5f35-cc9b-4538-b669-c8310e6fad26" released by "delete_snapshot" :: held 1.707s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:04 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 Sep 25 16:30:04 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Created reservations ['7b1eb284-06f7-40b1-a53e-e8b5f67171e6', 'da36bbd6-8bc0-49a0-bca9-99ba3bb82fe9', '9bfc03b7-a1b5-4676-ace0-7608a395e986', '572bad76-42aa-4712-b297-5152a31b0ce1'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:30:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-97b2c4ee-13b8-4e3a-a23a-22d587f70f46 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-e679c170-27df-4ce5-a231-6fac31d7bec4-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:05 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2" returned: 0 in 0.286s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.info Sep 25 16:30:05 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-69ae5f35-cc9b-4538-b669-c8310e6fad26-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-69ae5f35-cc9b-4538-b669-c8310e6fad26-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-69ae5f35-cc9b-4538-b669-c8310e6fad26" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-69ae5f35-cc9b-4538-b669-c8310e6fad26" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e44a9-83ad-4328-8d6d-6247a92ce59e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.info" returned: 0 in 0.298s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:05 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.info is being set with open permissions: ugo+rw Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.info Sep 25 16:30:05 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:05 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 Sep 25 16:30:05 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:05 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.info" returned: 0 in 0.289s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:05 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d7e4ddbe-cb1b-4e92-8aa4-bab8a2cdedc2 tempest-ProjectReaderTests-1864031062 None] Create snapshot completed successfully Sep 25 16:30:05 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26" returned: 0 in 0.408s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:05 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26 Sep 25 16:30:05 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:06 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-69ae5f35-cc9b-4538-b669-c8310e6fad26" returned: 0 in 0.268s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-69ae5f35-cc9b-4538-b669-c8310e6fad26" released by "delete_volume" :: held 0.741s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Created reservations ['29a87187-6704-4af2-a785-d0e120730c86', 'cffbd918-ff31-401b-b037-f060712a942f', 'c66dcbce-126c-460e-a295-894a790c4471', 'd48f9308-25e2-43f9-a1c1-eba2892caf4f'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:06 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:06 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:06 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.262s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-6428184c-74f6-4456-8572-019f34b3a0a8 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-69ae5f35-cc9b-4538-b669-c8310e6fad26-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-78940230-0e76-4245-b9d1-0d1f7b3a1ea2-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-78940230-0e76-4245-b9d1-0d1f7b3a1ea2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-06f3d363-62cd-4668-a705-a479c2d25bc6" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-06f3d363-62cd-4668-a705-a479c2d25bc6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-78940230-0e76-4245-b9d1-0d1f7b3a1ea2" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-78940230-0e76-4245-b9d1-0d1f7b3a1ea2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Deleting offline snapshot 78940230-0e76-4245-b9d1-0d1f7b3a1ea2 of volume 06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] snapshot_file for this snap is: volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a85590f-b51d-490b-95d8-54b644d8c503]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:06 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 Sep 25 16:30:06 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:06 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (c1e0dafb-05a1-4684-957f-0f3e50117548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a9b859-15bc-4e8e-86fd-fa288ee1bb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a9b859-15bc-4e8e-86fd-fa288ee1bb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067827058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2951181-0d42-42d2-9339-1551decc16d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:07Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd749435-eae2-41b8-b9d4-640e1bf4432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd749435-eae2-41b8-b9d4-640e1bf4432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8cb0bc-a3cd-4b01-8b9f-3bb675579ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8cb0bc-a3cd-4b01-8b9f-3bb675579ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2951181-0d42-42d2-9339-1551decc16d2', 'volume_name': 'volume-b2951181-0d42-42d2-9339-1551decc16d2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0791daca-89af-439b-8c2a-cb0a6e7257d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0791daca-89af-439b-8c2a-cb0a6e7257d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c9fa2-0a87-4e1b-89f7-7e336e153881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Volume b2951181-0d42-42d2-9339-1551decc16d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2951181-0d42-42d2-9339-1551decc16d2', 'volume_size': 1} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067827058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2951181-0d42-42d2-9339-1551decc16d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:07Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Creating volume b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:07 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:07 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 1073741824 Sep 25 16:30:07 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:07 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2" returned: 0 in 0.444s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06f3d363-62cd-4668-a705-a479c2d25bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e556a48-f4d1-4dcc-8675-7d58937cc785]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:07 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 Sep 25 16:30:07 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:07 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 1073741824" returned: 0 in 0.535s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:07 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6" returned: 0 in 0.430s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:07 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 Sep 25 16:30:07 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:07 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 Sep 25 16:30:07 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:07 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2" returned: 0 in 0.273s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c9fa2-0a87-4e1b-89f7-7e336e153881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2951181-0d42-42d2-9339-1551decc16d2', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c4cee-9b75-42cd-8cfd-16f2c0217333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:07 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Volume volume-b2951181-0d42-42d2-9339-1551decc16d2 (b2951181-0d42-42d2-9339-1551decc16d2): created successfully Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c4cee-9b75-42cd-8cfd-16f2c0217333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:07 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (c1e0dafb-05a1-4684-957f-0f3e50117548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:08 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-178e8fcc-5077-4781-a0c0-286f824e47e7 tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:30:08 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2" returned: 0 in 0.413s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:08 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2 Sep 25 16:30:08 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:08 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6.78940230-0e76-4245-b9d1-0d1f7b3a1ea2" returned: 0 in 0.257s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-78940230-0e76-4245-b9d1-0d1f7b3a1ea2" released by "_delete_snapshot" :: held 1.677s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-06f3d363-62cd-4668-a705-a479c2d25bc6" released by "delete_snapshot" :: held 1.702s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Created reservations ['35de2ebe-33cb-4e70-b1f4-be1b7812f5b6', 'a6f496d5-563c-401d-9b60-e6ff2c095d41', '05a8d46a-61dd-4e90-874e-b6260df6951a', 'cbe8dcf6-108f-44d1-bb62-8ea6fd3d5b03'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:08 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Delete snapshot completed successfully. Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-02c527d1-cbb3-49df-b5d7-a465c0be878c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-78940230-0e76-4245-b9d1-0d1f7b3a1ea2-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-06f3d363-62cd-4668-a705-a479c2d25bc6-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-06f3d363-62cd-4668-a705-a479c2d25bc6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Acquiring lock "cinder-quobyte-06f3d363-62cd-4668-a705-a479c2d25bc6" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-06f3d363-62cd-4668-a705-a479c2d25bc6" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a44b1b-9315-41e3-85ba-d56aa9602325]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 Sep 25 16:30:09 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot 806a3655-e95b-452a-8632-325b07510c32 of volume b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0d0ec9-4a16-4bcd-bd72-b5292b63f52c]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6" returned: 0 in 0.414s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6 Sep 25 16:30:09 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 Sep 25 16:30:09 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-06f3d363-62cd-4668-a705-a479c2d25bc6" returned: 0 in 0.287s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-quobyte-06f3d363-62cd-4668-a705-a479c2d25bc6" released by "delete_volume" :: held 0.776s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:09 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2" returned: 0 in 0.416s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Created reservations ['39713a72-7265-4e50-89fe-a0e5b9d9beb9', '3dfb1c6f-3548-47b7-8003-9bf5d0fc9ddc', '8567f1f4-b554-48f5-8d16-f27115c43851', '21b4a0ff-8333-44c4-8fb6-8a2889afcf7e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:09 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 1G Sep 25 16:30:09 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:09 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:09 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:09 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:10 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.307s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:10 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Deleted volume successfully. Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-77842ce5-21c4-41ce-bdbc-16adb2ac1f2c tempest-ProjectReaderTests-1864031062 None] Lock "cinder-06f3d363-62cd-4668-a705-a479c2d25bc6-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:10 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 1G" returned: 0 in 0.510s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2951181-0d42-42d2-9339-1551decc16d2 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:10 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2951181-0d42-42d2-9339-1551decc16d2 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 Sep 25 16:30:10 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:10 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2951181-0d42-42d2-9339-1551decc16d2 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32" returned: 0 in 0.338s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:10 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 is being set with open permissions: ugo+rw Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:10 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 Sep 25 16:30:10 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:10 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32" returned: 0 in 0.275s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:10 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.info Sep 25 16:30:10 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:11 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.info" returned: 0 in 0.301s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:11 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.info is being set with open permissions: ugo+rw Sep 25 16:30:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:11 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.info Sep 25 16:30:11 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:11 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.info" returned: 0 in 0.320s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:11 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:11 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-89775e0b-e781-450f-adb8-9f0d44c1e711 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-806a3655-e95b-452a-8632-325b07510c32-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-806a3655-e95b-452a-8632-325b07510c32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-b2951181-0d42-42d2-9339-1551decc16d2" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-b2951181-0d42-42d2-9339-1551decc16d2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-806a3655-e95b-452a-8632-325b07510c32" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-806a3655-e95b-452a-8632-325b07510c32" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot 806a3655-e95b-452a-8632-325b07510c32 of volume b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8520c24-c700-41f1-8260-465ba1aba80d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:12 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 Sep 25 16:30:12 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:12 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32" returned: 0 in 0.434s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:12 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2951181-0d42-42d2-9339-1551decc16d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:13 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc48dc8-4f58-40c7-a5b9-67a0488d5b57]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:13 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 Sep 25 16:30:13 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:13 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2" returned: 0 in 0.415s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:13 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 Sep 25 16:30:13 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:13 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32" returned: 0 in 0.384s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:13 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:13 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32 Sep 25 16:30:13 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:14 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2.806a3655-e95b-452a-8632-325b07510c32" returned: 0 in 0.288s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-806a3655-e95b-452a-8632-325b07510c32" released by "_delete_snapshot" :: held 1.646s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-b2951181-0d42-42d2-9339-1551decc16d2" released by "delete_snapshot" :: held 1.674s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Created reservations ['f3676f7d-6064-4131-9527-6f8b3e7bd912', 'e9887034-4768-41a8-b0ce-f776f48e1fa9', '8544ba8c-74f6-48dd-bda9-fb848feb439d', '4b1eca9b-b92b-4d96-84e2-4ff1606883bc'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:14 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-ec58689b-9bb6-47f9-8d64-cec3923986e1 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-806a3655-e95b-452a-8632-325b07510c32-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-b2951181-0d42-42d2-9339-1551decc16d2-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-b2951181-0d42-42d2-9339-1551decc16d2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-b2951181-0d42-42d2-9339-1551decc16d2" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-b2951181-0d42-42d2-9339-1551decc16d2" acquired by "delete_volume" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3b6a3-40af-4815-8b83-4bcdc370cab6]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:14 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:14 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 Sep 25 16:30:14 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:15 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2" returned: 0 in 0.397s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:15 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2 Sep 25 16:30:15 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:15 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b2951181-0d42-42d2-9339-1551decc16d2" returned: 0 in 0.309s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-b2951181-0d42-42d2-9339-1551decc16d2" released by "delete_volume" :: held 0.777s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:15 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:15 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Created reservations ['ce8996cf-7861-4901-a4c8-ec53db8d6f54', '55afc0e9-357b-4610-9aa2-52d1508689ad', '4b733260-353d-493e-8bd1-a0b46388834a', '63fb8546-8a13-491a-9ff4-d15227b73fde'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:15 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:15 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:15 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.358s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:30:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:30:15 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.326s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:16 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-1ac3456b-158c-4623-bd89-46282fd2d788 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-b2951181-0d42-42d2-9339-1551decc16d2-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (9c50b3b3-dce1-4ad2-b2dd-49d4ee749ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389e2bd8-2477-4646-9ebc-fd28477d4837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389e2bd8-2477-4646-9ebc-fd28477d4837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415355416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b9e19c-2e4d-4c5e-87a4-aa04d453217c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:16Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dc6dff-acd2-40c2-828b-b4bcae8ada09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dc6dff-acd2-40c2-828b-b4bcae8ada09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4fe8bb-d7ce-4c85-b2c4-945704b88544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4fe8bb-d7ce-4c85-b2c4-945704b88544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b9e19c-2e4d-4c5e-87a4-aa04d453217c', 'volume_name': 'volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcab80d-63d6-476b-ad14-f4c58c146e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcab80d-63d6-476b-ad14-f4c58c146e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0900baf-be5e-4a93-9405-dabd7a4c0bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:16 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Volume f9b9e19c-2e4d-4c5e-87a4-aa04d453217c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c', 'volume_size': 1} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415355416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b9e19c-2e4d-4c5e-87a4-aa04d453217c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:16Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Creating volume f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:16 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:16 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:16 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c 1073741824 Sep 25 16:30:16 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:17 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c 1073741824" returned: 0 in 0.501s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:17 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c Sep 25 16:30:17 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:17 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" returned: 0 in 0.259s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0900baf-be5e-4a93-9405-dabd7a4c0bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c64e48-815e-4267-b60e-ab8a48dfe88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:17 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Volume volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c (f9b9e19c-2e4d-4c5e-87a4-aa04d453217c): created successfully Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c64e48-815e-4267-b60e-ab8a48dfe88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:17 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (9c50b3b3-dce1-4ad2-b2dd-49d4ee749ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:17 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-9472b205-70f3-4445-8d75-a3bff541945b tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:30:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:18 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot e2777ace-4c46-48fa-aac0-eb1e7bb62942 of volume f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:18 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[286f08c5-9da6-419f-b5eb-54a13da304ea]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:18 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:18 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c Sep 25 16:30:18 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:19 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" returned: 0 in 0.365s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:19 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 1G Sep 25 16:30:19 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:19 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 1G" returned: 0 in 0.412s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:19 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 Sep 25 16:30:19 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:19 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942" returned: 0 in 0.337s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:19 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 is being set with open permissions: ugo+rw Sep 25 16:30:19 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:20 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 Sep 25 16:30:20 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:20 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942" returned: 0 in 0.258s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:20 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.info Sep 25 16:30:20 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:20 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.info" returned: 0 in 0.278s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:20 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.info is being set with open permissions: ugo+rw Sep 25 16:30:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:20 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.info Sep 25 16:30:20 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:20 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.info" returned: 0 in 0.288s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:20 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:20 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-59a4dd59-5a18-4c7b-9a72-798aef561cf9 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:30:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-e2777ace-4c46-48fa-aac0-eb1e7bb62942-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Lock "cinder-e2777ace-4c46-48fa-aac0-eb1e7bb62942-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-e2777ace-4c46-48fa-aac0-eb1e7bb62942" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:21 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-e2777ace-4c46-48fa-aac0-eb1e7bb62942" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:21 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot e2777ace-4c46-48fa-aac0-eb1e7bb62942 of volume f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a05675-8d80-43cf-a198-376842846aa0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 Sep 25 16:30:22 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:22 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942" returned: 0 in 0.376s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b985cb0d-6f88-4389-aec5-a0cbd6025a17]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c Sep 25 16:30:22 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:22 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" returned: 0 in 0.418s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:22 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:22 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 Sep 25 16:30:22 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:23 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942" returned: 0 in 0.406s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:23 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942 Sep 25 16:30:23 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:23 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:23 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c.e2777ace-4c46-48fa-aac0-eb1e7bb62942" returned: 0 in 0.275s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-e2777ace-4c46-48fa-aac0-eb1e7bb62942" released by "_delete_snapshot" :: held 1.598s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" released by "delete_snapshot" :: held 1.628s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:23 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Created reservations ['01c80c85-0985-48a5-b7fd-f0d3ca83b653', 'c54192ed-b9c4-44cd-a141-58558a1e3334', '2c15e7ef-ef86-470d-a597-c78495182261', '4275847c-8886-4ee6-a6a4-5ab5453d0e01'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:23 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:30:23 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-8250db55-d9b8-492d-9e99-b4a090e536ee tempest-ProjectMemberTests-1709475716 None] Lock "cinder-e2777ace-4c46-48fa-aac0-eb1e7bb62942-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Flow 'volume_create_manager' (c1bd4a5f-b9d5-4724-8a99-9dff5bdd47b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f34ae88-42b7-4d69-ab2b-eddef05bad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f34ae88-42b7-4d69-ab2b-eddef05bad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344202308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341729d5-b8b0-4c55-a8f1-3b0e256f448d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8659af4be7134d57a6db696385484701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:24Z,use_quota=True,user_id='48f1065b89da4ce6b9d5dcd57f0c1dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53535ed-202a-4cfa-8500-5b06967d0d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53535ed-202a-4cfa-8500-5b06967d0d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec2c8ed-a276-4c0d-af58-62afea180ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec2c8ed-a276-4c0d-af58-62afea180ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341729d5-b8b0-4c55-a8f1-3b0e256f448d', 'volume_name': 'volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4901dfbd-0fa1-4afe-8c47-1e2854370fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4901dfbd-0fa1-4afe-8c47-1e2854370fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82710b68-d010-488f-8e4d-3d022969da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:24 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Volume 341729d5-b8b0-4c55-a8f1-3b0e256f448d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d', 'volume_size': 1} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344202308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341729d5-b8b0-4c55-a8f1-3b0e256f448d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8659af4be7134d57a6db696385484701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:24Z,use_quota=True,user_id='48f1065b89da4ce6b9d5dcd57f0c1dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Creating volume 341729d5-b8b0-4c55-a8f1-3b0e256f448d {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:24 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:24 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d 1073741824 Sep 25 16:30:24 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" acquired by "delete_volume" :: waited 0.015s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96c5752-4811-4a4d-b7bc-ae2c31816acb]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:24 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c Sep 25 16:30:24 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:24 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d 1073741824" returned: 0 in 0.426s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:24 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d Sep 25 16:30:24 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:24 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" returned: 0 in 0.387s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:24 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c Sep 25 16:30:24 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:24 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d" returned: 0 in 0.267s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82710b68-d010-488f-8e4d-3d022969da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab391e01-a330-4601-8dff-e47de3ecf995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:24 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Volume volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d (341729d5-b8b0-4c55-a8f1-3b0e256f448d): created successfully Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab391e01-a330-4601-8dff-e47de3ecf995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:24 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Flow 'volume_create_manager' (c1bd4a5f-b9d5-4724-8a99-9dff5bdd47b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:24 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" returned: 0 in 0.299s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c" released by "delete_volume" :: held 0.758s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-916f9322-2e02-4b5a-9a92-239261a6e3bd tempest-ProjectReaderTests-1252003 None] Created volume successfully. Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Created reservations ['d2f007c3-9ba3-4918-8232-8d78cf9a6187', 'b2547501-0986-4196-aa26-555a96171724', '603239c6-49a2-4ae0-98b3-02cc73986b72', '9f71457c-28f6-4894-a8fb-24854285f219'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:25 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Acquiring lock "cinder-341729d5-b8b0-4c55-a8f1-3b0e256f448d-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Lock "cinder-341729d5-b8b0-4c55-a8f1-3b0e256f448d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Acquiring lock "cinder-quobyte-341729d5-b8b0-4c55-a8f1-3b0e256f448d" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Lock "cinder-quobyte-341729d5-b8b0-4c55-a8f1-3b0e256f448d" acquired by "delete_volume" :: waited 0.022s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8940fd-9f1e-4308-9632-ee3fb6b235ed]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.305s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:25 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-238dc2e1-163f-4624-9f06-16abd9d62df4 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-f9b9e19c-2e4d-4c5e-87a4-aa04d453217c-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:25 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d Sep 25 16:30:25 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (a48f030a-a1ba-4eab-b875-173dc6298f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcde5a9f-1fb2-4985-a2ac-dd6fc6f4bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcde5a9f-1fb2-4985-a2ac-dd6fc6f4bc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553936216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b16970-0d67-4ed2-bad0-e1bbb27c416b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:26Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d302e66-fa5a-4284-bc56-b7affab7562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d302e66-fa5a-4284-bc56-b7affab7562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c124e3-8107-4272-b330-02c1ea8f1949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c124e3-8107-4272-b330-02c1ea8f1949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b16970-0d67-4ed2-bad0-e1bbb27c416b', 'volume_name': 'volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab6b29a-e2b5-4c90-aee8-682564caca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab6b29a-e2b5-4c90-aee8-682564caca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3cc6d4-4e66-4a0a-8fd5-d8a2885e1ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:25 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Volume a9b16970-0d67-4ed2-bad0-e1bbb27c416b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b', 'volume_size': 1} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553936216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b16970-0d67-4ed2-bad0-e1bbb27c416b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:26Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Creating volume a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:25 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b 1073741824 Sep 25 16:30:25 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:25 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d" returned: 0 in 0.470s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:25 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:25 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d Sep 25 16:30:25 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:26 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-341729d5-b8b0-4c55-a8f1-3b0e256f448d" returned: 0 in 0.289s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Lock "cinder-quobyte-341729d5-b8b0-4c55-a8f1-3b0e256f448d" released by "delete_volume" :: held 0.813s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Created reservations ['c08ea7f1-f3b2-4041-8398-f7f6a456d682', '45987e3b-c3a5-40e2-812c-8c3a4a1090bd', '1401e8c9-432a-40c7-9074-6becd82615f7', '0304d09e-bed7-4400-96dc-fbb2f983a596'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:26 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b 1073741824" returned: 0 in 0.482s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:26 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:26 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:26 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b Sep 25 16:30:26 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:26 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.318s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Deleted volume successfully. Sep 25 16:30:26 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" returned: 0 in 0.323s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-389ea040-4679-465d-b7e6-931efca1c79e tempest-ProjectReaderTests-1252003 None] Lock "cinder-341729d5-b8b0-4c55-a8f1-3b0e256f448d-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3cc6d4-4e66-4a0a-8fd5-d8a2885e1ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f39b1c-7beb-4ceb-bc73-80b95e4fdcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:26 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Volume volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b (a9b16970-0d67-4ed2-bad0-e1bbb27c416b): created successfully Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f39b1c-7beb-4ceb-bc73-80b95e4fdcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:26 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (a48f030a-a1ba-4eab-b875-173dc6298f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:26 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-4427e21c-0093-44e6-a801-d08b8c9ce2e5 tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Flow 'volume_create_manager' (0fef1e3e-9975-4155-9868-856b6e6842dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343f8b9a-d341-424f-92e4-096332d5262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343f8b9a-d341-424f-92e4-096332d5262a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392823936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584a35a9-3d33-436c-9c86-cc5d14fbcad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8659af4be7134d57a6db696385484701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:27Z,use_quota=True,user_id='48f1065b89da4ce6b9d5dcd57f0c1dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a210bbe-5a14-4b79-93f2-35f14fa71bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a210bbe-5a14-4b79-93f2-35f14fa71bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210f1089-1c24-41f4-b960-c8f521948d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210f1089-1c24-41f4-b960-c8f521948d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584a35a9-3d33-436c-9c86-cc5d14fbcad1', 'volume_name': 'volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34bd6bf-b8fb-4daa-a613-a9cb33097229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34bd6bf-b8fb-4daa-a613-a9cb33097229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed4645f-75f9-4415-bf37-192262cca48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Volume 584a35a9-3d33-436c-9c86-cc5d14fbcad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1', 'volume_size': 1} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392823936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584a35a9-3d33-436c-9c86-cc5d14fbcad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8659af4be7134d57a6db696385484701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:27Z,use_quota=True,user_id='48f1065b89da4ce6b9d5dcd57f0c1dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Creating volume 584a35a9-3d33-436c-9c86-cc5d14fbcad1 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:27 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:27 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 1073741824 Sep 25 16:30:27 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:27 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 1073741824" returned: 0 in 0.446s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:27 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 Sep 25 16:30:27 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:27 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1" returned: 0 in 0.280s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed4645f-75f9-4415-bf37-192262cca48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f83020d-5bc5-46e9-a7d8-6f4b5530e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:27 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Volume volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 (584a35a9-3d33-436c-9c86-cc5d14fbcad1): created successfully Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f83020d-5bc5-46e9-a7d8-6f4b5530e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:27 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Flow 'volume_create_manager' (0fef1e3e-9975-4155-9868-856b6e6842dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:27 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-57ea1c19-89a1-4a65-b12e-370f8938de9f tempest-ProjectReaderTests-1252003 None] Created volume successfully. Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Acquiring lock "cinder-584a35a9-3d33-436c-9c86-cc5d14fbcad1-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Lock "cinder-584a35a9-3d33-436c-9c86-cc5d14fbcad1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot a7d9147a-8c41-47dc-bde8-f2d3ad5cecde of volume a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[00358bde-bd17-45bf-bbc6-68419940440d]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Acquiring lock "cinder-quobyte-584a35a9-3d33-436c-9c86-cc5d14fbcad1" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Lock "cinder-quobyte-584a35a9-3d33-436c-9c86-cc5d14fbcad1" acquired by "delete_volume" :: waited 0.024s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cea0f42-6053-4da0-97da-c7b20bcd7cc4]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b Sep 25 16:30:28 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 Sep 25 16:30:28 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" returned: 0 in 0.377s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde 1G Sep 25 16:30:28 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1" returned: 0 in 0.389s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:28 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1 Sep 25 16:30:28 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:28 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-584a35a9-3d33-436c-9c86-cc5d14fbcad1" returned: 0 in 0.285s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:28 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Lock "cinder-quobyte-584a35a9-3d33-436c-9c86-cc5d14fbcad1" released by "delete_volume" :: held 0.724s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Created reservations ['dc2810dd-ddf4-41e8-ba34-6ed18c33602b', '31347456-e22d-408a-90d1-24af281d8791', '75a7adbd-ba37-46fb-bf1a-d4f59a113a37', '11a751c8-41de-4b16-ac70-02ff7e2e6e87'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:29 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde 1G" returned: 0 in 0.486s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:29 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde Sep 25 16:30:29 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:29 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:29 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:29 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:29 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.281s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" returned: 0 in 0.357s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:29 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde is being set with open permissions: ugo+rw Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:29 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Deleted volume successfully. Sep 25 16:30:29 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde Sep 25 16:30:29 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-05e5bb15-2c30-482c-827c-c83bfa755797 tempest-ProjectReaderTests-1252003 None] Lock "cinder-584a35a9-3d33-436c-9c86-cc5d14fbcad1-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:29 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" returned: 0 in 0.269s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:29 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.info Sep 25 16:30:29 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:29 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.info" returned: 0 in 0.288s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:29 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.info is being set with open permissions: ugo+rw Sep 25 16:30:29 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:30 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.info Sep 25 16:30:30 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:30 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.info" returned: 0 in 0.314s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:30 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:30 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-546813c3-3660-4a7b-9d96-4df92ebb1a57 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-a7d9147a-8c41-47dc-bde8-f2d3ad5cecde-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-a7d9147a-8c41-47dc-bde8-f2d3ad5cecde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot a7d9147a-8c41-47dc-bde8-f2d3ad5cecde of volume a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b0b34e-9cad-4a6c-914a-6a458edc9e8f]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:31 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde Sep 25 16:30:31 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:31 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" returned: 0 in 0.376s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b288c168-5790-4637-a7a9-5b01d1109a49]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:31 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:31 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b Sep 25 16:30:31 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:32 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" returned: 0 in 0.382s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:32 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde Sep 25 16:30:32 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:32 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" returned: 0 in 0.352s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:32 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde Sep 25 16:30:32 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:32 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b.a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" returned: 0 in 0.272s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-a7d9147a-8c41-47dc-bde8-f2d3ad5cecde" released by "_delete_snapshot" :: held 1.487s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" released by "delete_snapshot" :: held 1.510s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:32 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Created reservations ['1fac9f9e-0705-4798-ae27-29e42e7049f3', '7cf1b71a-6455-40c8-b2e4-9db884ded113', 'edad69af-3592-40a2-8048-43fa3117e5e4', '4aeac873-b91e-4455-b119-1ce5db649419'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:33 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d6cdf3ab-d753-4e30-a535-7c467b5201a0 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-a7d9147a-8c41-47dc-bde8-f2d3ad5cecde-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-a9b16970-0d67-4ed2-bad0-e1bbb27c416b-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-a9b16970-0d67-4ed2-bad0-e1bbb27c416b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" acquired by "delete_volume" :: waited 0.015s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[3423c22d-f77d-445e-9609-f256585ade36]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:33 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b Sep 25 16:30:33 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:33 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" returned: 0 in 0.399s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:33 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:34 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b Sep 25 16:30:34 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:34 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" returned: 0 in 0.294s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-a9b16970-0d67-4ed2-bad0-e1bbb27c416b" released by "delete_volume" :: held 0.750s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Created reservations ['f2526297-ab0f-42e3-8a17-10c8b7b28bbe', 'f3d36d9a-0044-46b9-abc9-d35fa29d497f', '43193835-57eb-4a14-bae1-67d968da7636', 'b464cbab-f278-46b8-8097-960eaae86462'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:34 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:34 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:34 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.274s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:34 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:30:34 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d7cef622-6448-49d1-bf42-a4ced3d06580 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-a9b16970-0d67-4ed2-bad0-e1bbb27c416b-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (09581f77-7272-455b-9e4b-e1db683b5a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2e7fa8-16ad-4905-b22e-42e8c400aa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2e7fa8-16ad-4905-b22e-42e8c400aa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794813206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c35b920-e953-4448-a966-36a3c469a887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:35Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8219335-f482-4616-a0b1-60a863ea0269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8219335-f482-4616-a0b1-60a863ea0269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1ebcba-37ae-4383-be3e-3e170e78e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1ebcba-37ae-4383-be3e-3e170e78e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c35b920-e953-4448-a966-36a3c469a887', 'volume_name': 'volume-5c35b920-e953-4448-a966-36a3c469a887', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6cf68b-01da-4ec2-af62-1d5d18e49d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6cf68b-01da-4ec2-af62-1d5d18e49d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e04492-7ef3-45d3-b900-270dfce3f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Volume 5c35b920-e953-4448-a966-36a3c469a887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c35b920-e953-4448-a966-36a3c469a887', 'volume_size': 1} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794813206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c35b920-e953-4448-a966-36a3c469a887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc88753a3a04e669d08d27e0ed32462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:35Z,use_quota=True,user_id='d2d0e7bf223d4d18be5c0f7c3ccc5a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Creating volume 5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:35 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:35 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 1073741824 Sep 25 16:30:35 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:35 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 1073741824" returned: 0 in 0.442s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:35 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 Sep 25 16:30:35 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:35 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887" returned: 0 in 0.258s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e04492-7ef3-45d3-b900-270dfce3f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c35b920-e953-4448-a966-36a3c469a887', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5350d3-0836-43da-8b19-1ef27419a2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:35 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Volume volume-5c35b920-e953-4448-a966-36a3c469a887 (5c35b920-e953-4448-a966-36a3c469a887): created successfully Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5350d3-0836-43da-8b19-1ef27419a2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:35 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Flow 'volume_create_manager' (09581f77-7272-455b-9e4b-e1db683b5a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:35 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-35a327ca-7c8d-445a-85ce-aad3a8368846 tempest-ProjectMemberTests-1709475716 None] Created volume successfully. Sep 25 16:30:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:36 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Creating offline snapshot 233f8bff-9b02-408d-84b6-9c0ed687d28d of volume 5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 16:30:36 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee408b0-7514-4202-bfa7-3fde1b2ea5b0]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:36 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 Sep 25 16:30:36 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:36 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887" returned: 0 in 0.452s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:36 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d 1G {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:36 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d 1G Sep 25 16:30:36 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:37 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d 1G" returned: 0 in 0.451s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c35b920-e953-4448-a966-36a3c469a887 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:37 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c35b920-e953-4448-a966-36a3c469a887 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d Sep 25 16:30:37 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:37 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c35b920-e953-4448-a966-36a3c469a887 -F qcow2 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d" returned: 0 in 0.319s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:37 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d is being set with open permissions: ugo+rw Sep 25 16:30:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:37 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d Sep 25 16:30:37 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:37 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d" returned: 0 in 0.273s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:37 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:37 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.info Sep 25 16:30:37 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:38 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.info" returned: 0 in 0.268s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:38 devstack cinder-volume[87467]: WARNING cinder.volume.drivers.remotefs [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.info is being set with open permissions: ugo+rw Sep 25 16:30:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.info {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:38 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.info Sep 25 16:30:38 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:38 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.info" returned: 0 in 0.249s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:38 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:38 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-210b3ffb-5018-4600-a97d-fa78267f75d5 tempest-ProjectMemberTests-1709475716 None] Create snapshot completed successfully Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-233f8bff-9b02-408d-84b6-9c0ed687d28d-delete_snapshot" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Lock "cinder-233f8bff-9b02-408d-84b6-9c0ed687d28d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-5c35b920-e953-4448-a966-36a3c469a887" by "delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5c35b920-e953-4448-a966-36a3c469a887" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-233f8bff-9b02-408d-84b6-9c0ed687d28d" by "_delete_snapshot" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-233f8bff-9b02-408d-84b6-9c0ed687d28d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Deleting offline snapshot 233f8bff-9b02-408d-84b6-9c0ed687d28d of volume 5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] snapshot_file for this snap is: volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d {{(pid=87467) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d74650-7d27-4457-a0ed-1ac17da09668]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:39 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:39 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d Sep 25 16:30:39 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:40 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d" returned: 0 in 0.368s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c35b920-e953-4448-a966-36a3c469a887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87467) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e84b4-90ed-443a-ae9b-4049f97a2171]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 Sep 25 16:30:40 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:40 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887" returned: 0 in 0.371s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d Sep 25 16:30:40 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:40 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d" returned: 0 in 0.350s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:40 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:40 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d Sep 25 16:30:40 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:41 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887.233f8bff-9b02-408d-84b6-9c0ed687d28d" returned: 0 in 0.261s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-233f8bff-9b02-408d-84b6-9c0ed687d28d" released by "_delete_snapshot" :: held 1.459s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5c35b920-e953-4448-a966-36a3c469a887" released by "delete_snapshot" :: held 1.482s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Created reservations ['028f82cd-ffe3-4ae4-ae9d-077dacc59e1c', '56ed34f1-7d51-4822-a112-10be460342fa', 'd19c43f7-65fb-46aa-8fae-72aab30e0e73', 'fc9b3aa7-30d1-468c-be41-c586dff7c30e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:41 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Delete snapshot completed successfully. Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-974ebae1-c642-4613-9271-461aa00a5efa tempest-ProjectMemberTests-1709475716 None] Lock "cinder-233f8bff-9b02-408d-84b6-9c0ed687d28d-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-5c35b920-e953-4448-a966-36a3c469a887-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-5c35b920-e953-4448-a966-36a3c469a887-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "cinder-quobyte-5c35b920-e953-4448-a966-36a3c469a887" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5c35b920-e953-4448-a966-36a3c469a887" acquired by "delete_volume" :: waited 0.017s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[009682ce-efc6-404c-b239-60c199e8bb79]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:41 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:41 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 Sep 25 16:30:41 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:42 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887" returned: 0 in 0.384s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:42 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887 Sep 25 16:30:42 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:42 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-5c35b920-e953-4448-a966-36a3c469a887" returned: 0 in 0.264s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-quobyte-5c35b920-e953-4448-a966-36a3c469a887" released by "delete_volume" :: held 0.711s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Created reservations ['41704028-4034-4959-993d-501e472ee93b', '782f347c-49b3-47c7-be0b-9d0a005d7097', '0577ce07-6ca9-4a6b-a7c3-37fe0a0f271c', 'a5869ece-78c8-4ce9-a180-04a186210009'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:42 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:42 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:42 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.258s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:42 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Deleted volume successfully. Sep 25 16:30:42 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-81a881eb-16ad-402e-b5a3-2eb9582d6888 tempest-ProjectMemberTests-1709475716 None] Lock "cinder-5c35b920-e953-4448-a966-36a3c469a887-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:52 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=192,cinder:DELETE=11,cinder:SELECT=141,cinder:INSERT=47 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:30:52 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=154,cinder:UPDATE=198,cinder:INSERT=60,cinder:DELETE=21 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (61695928-b0db-44d5-9fff-4f469b13b14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf04bafb-2861-49a9-8a00-02301cbfd336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf04bafb-2861-49a9-8a00-02301cbfd336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007286019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff85c3f-e347-4b0f-a386-54a0e67e1414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:55Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3360f33b-a7fe-4eee-adb2-782978327f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3360f33b-a7fe-4eee-adb2-782978327f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052643f9-13dc-493b-b4e4-ba3146b163bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052643f9-13dc-493b-b4e4-ba3146b163bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff85c3f-e347-4b0f-a386-54a0e67e1414', 'volume_name': 'volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c9dd4-575c-48de-a512-871cc5a75858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c9dd4-575c-48de-a512-871cc5a75858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0991d7-ebc5-4eb1-8c7d-065dd027f89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:55 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Volume 3ff85c3f-e347-4b0f-a386-54a0e67e1414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414', 'volume_size': 1} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007286019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff85c3f-e347-4b0f-a386-54a0e67e1414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:55Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Creating volume 3ff85c3f-e347-4b0f-a386-54a0e67e1414 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:55 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:55 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 1073741824 Sep 25 16:30:55 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:55 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:55 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 1073741824" returned: 0 in 0.472s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:56 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 Sep 25 16:30:56 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:56 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414" returned: 0 in 0.261s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0991d7-ebc5-4eb1-8c7d-065dd027f89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55f8318-e788-4082-90fa-5113c4889876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:56 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Volume volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 (3ff85c3f-e347-4b0f-a386-54a0e67e1414): created successfully Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55f8318-e788-4082-90fa-5113c4889876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:56 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (61695928-b0db-44d5-9fff-4f469b13b14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:56 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b9abd299-a471-41d1-9be4-9a696e4da14b tempest-ProjectReaderTests-943708827 None] Created volume successfully. Sep 25 16:30:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-3ff85c3f-e347-4b0f-a386-54a0e67e1414-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Lock "cinder-3ff85c3f-e347-4b0f-a386-54a0e67e1414-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-quobyte-3ff85c3f-e347-4b0f-a386-54a0e67e1414" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:30:57 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-3ff85c3f-e347-4b0f-a386-54a0e67e1414" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:30:57 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[f395ba6b-dd45-4d08-ad54-aa5f4dad338e]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:30:57 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:57 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 Sep 25 16:30:57 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:58 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414" returned: 0 in 0.387s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:58 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414 Sep 25 16:30:58 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:58 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-3ff85c3f-e347-4b0f-a386-54a0e67e1414" returned: 0 in 0.273s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-3ff85c3f-e347-4b0f-a386-54a0e67e1414" released by "delete_volume" :: held 0.704s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Created reservations ['4887ae83-0fb3-4840-b6e5-230a070c26ea', '7e1c3412-9e06-4831-b58f-1627da3bf687', 'c39aab35-ac66-4bb7-b77e-ac2b31390298', 'ec237dc6-24b0-4b53-904d-e1e8e89ef38a'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:58 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:30:58 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:58 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.275s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:30:58 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Deleted volume successfully. Sep 25 16:30:58 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-d4941db7-91bc-4cd8-b338-3cc207f0773b tempest-ProjectReaderTests-943708827 None] Lock "cinder-3ff85c3f-e347-4b0f-a386-54a0e67e1414-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (e705e198-44bf-43ef-9c13-6d4682be9fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fad0d1-1fcb-4291-b6ae-9a6efca04d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fad0d1-1fcb-4291-b6ae-9a6efca04d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129642761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cd521f-09fd-4278-9ee9-ca24d2998cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:59Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9827ca-1fcb-4312-8ff1-bb9377192960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9827ca-1fcb-4312-8ff1-bb9377192960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfae60f3-2147-4988-ab18-cf639026cd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfae60f3-2147-4988-ab18-cf639026cd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8cd521f-09fd-4278-9ee9-ca24d2998cd9', 'volume_name': 'volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd5a6da-ee4b-4561-aac8-f6b346a1e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd5a6da-ee4b-4561-aac8-f6b346a1e535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce314a5e-4d9c-4c20-9397-11a7d53a3daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:30:59 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Volume b8cd521f-09fd-4278-9ee9-ca24d2998cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9', 'volume_size': 1} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129642761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cd521f-09fd-4278-9ee9-ca24d2998cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:30:59Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Creating volume b8cd521f-09fd-4278-9ee9-ca24d2998cd9 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:30:59 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:59 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 1073741824 Sep 25 16:30:59 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:30:59 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 1073741824" returned: 0 in 0.436s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:30:59 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:30:59 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 Sep 25 16:30:59 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:00 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9" returned: 0 in 0.263s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce314a5e-4d9c-4c20-9397-11a7d53a3daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388497b1-179d-491e-9d3b-700f4c38d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:00 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Volume volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 (b8cd521f-09fd-4278-9ee9-ca24d2998cd9): created successfully Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388497b1-179d-491e-9d3b-700f4c38d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (e705e198-44bf-43ef-9c13-6d4682be9fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:00 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-e1a0f7e3-8f58-4056-baa9-3d6dbab806a4 tempest-ProjectReaderTests-943708827 None] Created volume successfully. Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-b8cd521f-09fd-4278-9ee9-ca24d2998cd9-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Lock "cinder-b8cd521f-09fd-4278-9ee9-ca24d2998cd9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-quobyte-b8cd521f-09fd-4278-9ee9-ca24d2998cd9" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-b8cd521f-09fd-4278-9ee9-ca24d2998cd9" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebbe377-33a7-43cc-a1a3-a4f29d1f4426]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:00 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 Sep 25 16:31:00 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:00 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9" returned: 0 in 0.383s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:00 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:00 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9 Sep 25 16:31:00 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:01 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-b8cd521f-09fd-4278-9ee9-ca24d2998cd9" returned: 0 in 0.256s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-b8cd521f-09fd-4278-9ee9-ca24d2998cd9" released by "delete_volume" :: held 0.682s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Created reservations ['4bd477e8-b15c-4b86-b67d-b8b302b1b166', 'f9dd0842-1629-4050-b177-a078e88cc4b4', 'f129cdf1-9b14-4195-aca7-f7ffc05d5be7', '4adf7d7a-79e8-48da-9549-e092abdb708e'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:01 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:31:01 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:01 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.275s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:01 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Deleted volume successfully. Sep 25 16:31:01 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-b8ca3c92-6832-46b7-88fa-51230fd39a07 tempest-ProjectReaderTests-943708827 None] Lock "cinder-b8cd521f-09fd-4278-9ee9-ca24d2998cd9-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (ebd59d2a-54b7-4ce4-866e-7db107e5f71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba85e8-2276-410c-a318-186be778dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba85e8-2276-410c-a318-186be778dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384515893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0729c97-9934-4125-bac3-b85aec18323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:02Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8a40b9-f339-42e8-9912-f089a2481135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8a40b9-f339-42e8-9912-f089a2481135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d178cd6-c62e-4f56-94ce-289bc4c7a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d178cd6-c62e-4f56-94ce-289bc4c7a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0729c97-9934-4125-bac3-b85aec18323a', 'volume_name': 'volume-d0729c97-9934-4125-bac3-b85aec18323a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3526c5-0dd3-4361-baf1-3ec31c5a26d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3526c5-0dd3-4361-baf1-3ec31c5a26d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9cfbdf-6f9b-40d6-baa6-dc793b3c50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Volume d0729c97-9934-4125-bac3-b85aec18323a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0729c97-9934-4125-bac3-b85aec18323a', 'volume_size': 1} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384515893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0729c97-9934-4125-bac3-b85aec18323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:02Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Creating volume d0729c97-9934-4125-bac3-b85aec18323a {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:02 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:02 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a 1073741824 Sep 25 16:31:02 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:02 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a 1073741824" returned: 0 in 0.408s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:02 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a Sep 25 16:31:02 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:02 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a" returned: 0 in 0.255s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9cfbdf-6f9b-40d6-baa6-dc793b3c50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0729c97-9934-4125-bac3-b85aec18323a', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0862dc-b502-49f0-bfc2-2102181e9cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:02 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Volume volume-d0729c97-9934-4125-bac3-b85aec18323a (d0729c97-9934-4125-bac3-b85aec18323a): created successfully Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0862dc-b502-49f0-bfc2-2102181e9cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:02 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (ebd59d2a-54b7-4ce4-866e-7db107e5f71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:02 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-3f103eb7-a3ea-4a2f-81eb-fd9bd684ed6a tempest-ProjectReaderTests-943708827 None] Created volume successfully. Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-d0729c97-9934-4125-bac3-b85aec18323a-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Lock "cinder-d0729c97-9934-4125-bac3-b85aec18323a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-quobyte-d0729c97-9934-4125-bac3-b85aec18323a" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-d0729c97-9934-4125-bac3-b85aec18323a" acquired by "delete_volume" :: waited 0.014s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e42d9-031a-43ae-88c0-d13e5470cb76]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:03 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a Sep 25 16:31:03 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:03 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a" returned: 0 in 0.356s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:03 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a Sep 25 16:31:03 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:03 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-d0729c97-9934-4125-bac3-b85aec18323a" returned: 0 in 0.239s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-d0729c97-9934-4125-bac3-b85aec18323a" released by "delete_volume" :: held 0.634s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Created reservations ['7daec40a-21c1-4ba9-a583-940d8f2193a6', 'ccd1d51c-f731-4c50-83cf-2c716821daf2', '53e5aca0-74fd-4365-baa4-6cc80b04d685', 'a256c48e-311a-4e57-9f07-4b29935e97b0'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:03 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:03 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:31:03 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:04 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:04 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.251s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:04 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:04 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Deleted volume successfully. Sep 25 16:31:04 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-cfcb978a-d35d-404e-9630-47a595c0cf9c tempest-ProjectReaderTests-943708827 None] Lock "cinder-d0729c97-9934-4125-bac3-b85aec18323a-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.flows.manager.create_volume [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87467) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (305c162c-0e5d-42b2-b336-a489dd169de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd74cb7-fb85-47ce-80ff-9e9a7f65643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd74cb7-fb85-47ce-80ff-9e9a7f65643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015523395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed929f6b-87f4-4d35-93e7-95261f763c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:05Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3214bf-4cc0-489f-ab04-c727aee93056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3214bf-4cc0-489f-ab04-c727aee93056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0349be9d-f326-45f9-86ad-5c916ab15bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0349be9d-f326-45f9-86ad-5c916ab15bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed929f6b-87f4-4d35-93e7-95261f763c07', 'volume_name': 'volume-ed929f6b-87f4-4d35-93e7-95261f763c07', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4c0dc7-7640-482e-9b26-93906094e472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4c0dc7-7640-482e-9b26-93906094e472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eeaf21-f4e4-400f-b031-2affa51fdfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:05 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Volume ed929f6b-87f4-4d35-93e7-95261f763c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed929f6b-87f4-4d35-93e7-95261f763c07', 'volume_size': 1} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T14:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015523395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed929f6b-87f4-4d35-93e7-95261f763c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10eb1e381fe4cbf8e2f9bddfae4221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T14:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T14:31:05Z,use_quota=True,user_id='f46c5eedb35e47e988e0532d0ba98af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8b632a-70f0-4fb8-90df-0ed6a9d38b30),volume_type_id=6c8b632a-70f0-4fb8-90df-0ed6a9d38b30)}" {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.remotefs [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Creating volume ed929f6b-87f4-4d35-93e7-95261f763c07 {{(pid=87467) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 as target Quobyte volume. {{(pid=87467) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 16:31:05 devstack cinder-volume[87467]: INFO cinder.volume.drivers.remotefs [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051 Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 1073741824 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:05 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 1073741824 Sep 25 16:31:05 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:05 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 1073741824" returned: 0 in 0.426s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:05 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:05 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 Sep 25 16:31:05 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:06 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07" returned: 0 in 0.254s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:06 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'} {{(pid=87467) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 16:31:06 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eeaf21-f4e4-400f-b031-2affa51fdfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed929f6b-87f4-4d35-93e7-95261f763c07', 'volume_size': 1}' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d1ed22-c452-4095-8cc4-0ff0dc18cf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 16:31:06 devstack cinder-volume[87467]: INFO cinder.volume.flows.manager.create_volume [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Volume volume-ed929f6b-87f4-4d35-93e7-95261f763c07 (ed929f6b-87f4-4d35-93e7-95261f763c07): created successfully Sep 25 16:31:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d1ed22-c452-4095-8cc4-0ff0dc18cf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87467) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 16:31:06 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Flow 'volume_create_manager' (305c162c-0e5d-42b2-b336-a489dd169de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87467) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 16:31:06 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-676af187-5178-4a19-b660-62c73061859c tempest-ProjectReaderTests-943708827 None] Created volume successfully. Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-ed929f6b-87f4-4d35-93e7-95261f763c07-delete_volume" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Lock "cinder-ed929f6b-87f4-4d35-93e7-95261f763c07-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Acquiring lock "cinder-quobyte-ed929f6b-87f4-4d35-93e7-95261f763c07" by "delete_volume" {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-ed929f6b-87f4-4d35-93e7-95261f763c07" acquired by "delete_volume" :: waited 0.016s {{(pid=87467) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1baeb4-58d4-48ae-a5ca-17098a1ae5e7]: (4, 'qcow2') {{(pid=89060) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:07 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 Sep 25 16:31:07 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:07 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07" returned: 0 in 0.366s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:07 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:07 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07 Sep 25 16:31:07 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:08 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:08 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb/volume-ed929f6b-87f4-4d35-93e7-95261f763c07" returned: 0 in 0.259s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:08 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Lock "cinder-quobyte-ed929f6b-87f4-4d35-93e7-95261f763c07" released by "delete_volume" :: held 0.668s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG cinder.quota [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Created reservations ['72944220-1856-4121-9175-3df67dc20618', 'a13783a1-f9e3-48a7-991d-4e29648080dd', '2a584158-1fb2-4c89-bc86-c001a1ecaada', 'ebd12bfc-d792-4c70-928c-9509a0458009'] {{(pid=87467) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:10 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:31:10 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:10 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.251s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:10 devstack cinder-volume[87467]: INFO cinder.volume.manager [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Deleted volume successfully. Sep 25 16:31:10 devstack cinder-volume[87467]: DEBUG cinder.coordination [None req-59286d6a-1158-4918-9fde-c36dfa7eb01b tempest-ProjectReaderTests-943708827 None] Lock "cinder-ed929f6b-87f4-4d35-93e7-95261f763c07-delete_volume" released by "delete_volume" :: held 3.636s {{(pid=87467) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051': None} {{(pid=87467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG cinder.volume.drivers.quobyte [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3dd4d1-3c2c-42bf-a0e3-75a5ebbd1051'] {{(pid=87467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.lockutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:31:15 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb Sep 25 16:31:15 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:31:15 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG oslo_concurrency.processutils [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99901d0cac3067d0a59ca63520ffaffb" returned: 0 in 0.277s {{(pid=87467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG cinder.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Notifying Schedulers of capabilities ... {{(pid=87467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG oslo_service.periodic_task [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] Running periodic task VolumeManager._thread_info {{(pid=87467) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread count: 29 {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:31:15 devstack cinder-volume[87467]: DEBUG cinder.volume.manager [None req-01b5fb60-1529-4f85-872e-853cd41be48e None None] thread info: [<_MainThread(MainThread, started 131369846509696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87467) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:31:20 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=48,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:31:20 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=32,cinder:INSERT=11,cinder:UPDATE=40,cinder:DELETE=5 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:31:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:SELECT=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:31:42 devstack cinder-volume[87467]: DEBUG dbcounter [-] [87467] Writing DB stats cinder:UPDATE=1 {{(pid=87467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}